2023-09-28T13:01:55.568 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T13:01:55.568 DEBUG:teuthology.run:Teuthology command: teuthology --description rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} --owner scheduled_yuriw@teuthology --name yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802 --verbose -- /home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802/orig.config.yaml 2023-09-28T13:01:55.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:01:55.680 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802 branch: wip-yuri3-testing-2023-09-27-0919-quincy description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} email: yweinste@redhat.com first_in_suite: false job_id: '7403802' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-09-27-0919-quincy ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: 2c186684db7f9ea0cdb098fc86b350a0fdd26eba ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2c186684db7f9ea0cdb098fc86b350a0fdd26eba selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-09-27-0919-quincy sha1: 2c186684db7f9ea0cdb098fc86b350a0fdd26eba owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1925 sha1: 2c186684db7f9ea0cdb098fc86b350a0fdd26eba sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri3-testing-2023-09-27-0919-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 2c186684db7f9ea0cdb098fc86b350a0fdd26eba targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnJDlS/BXlSINjJJGcXbSPxbGrNZzdOVEDfBuvbD1N26QyGYGlNYw62XUaigjgXCvDWBhNHQtSmoc/xGP0IEDE= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-27_19:28:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-28T13:01:55.680 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa; will attempt to use it 2023-09-28T13:01:55.681 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa/tasks 2023-09-28T13:01:55.681 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-28T13:01:55.683 INFO:teuthology.task.internal:Checking packages... 2023-09-28T13:01:55.704 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '2c186684db7f9ea0cdb098fc86b350a0fdd26eba' 2023-09-28T13:01:55.704 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-28T13:01:55.704 INFO:teuthology.packaging:ref: None 2023-09-28T13:01:55.705 INFO:teuthology.packaging:tag: None 2023-09-28T13:01:55.705 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-09-27-0919-quincy 2023-09-28T13:01:55.705 INFO:teuthology.packaging:sha1: 2c186684db7f9ea0cdb098fc86b350a0fdd26eba 2023-09-28T13:01:55.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-09-27-0919-quincy 2023-09-28T13:01:55.844 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1143.g2c186684 2023-09-28T13:01:55.844 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-28T13:01:55.852 INFO:teuthology.task.internal:no buildpackages task found 2023-09-28T13:01:55.853 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-28T13:01:55.873 INFO:teuthology.task.internal:Saving configuration 2023-09-28T13:01:55.886 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-28T13:01:55.896 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T13:01:55.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 12:56:51.357886', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnJDlS/BXlSINjJJGcXbSPxbGrNZzdOVEDfBuvbD1N26QyGYGlNYw62XUaigjgXCvDWBhNHQtSmoc/xGP0IEDE='} 2023-09-28T13:01:55.922 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-28T13:01:55.931 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-09-28T13:01:55.931 INFO:teuthology.run_tasks:Running task console_log... 2023-09-28T13:01:55.975 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38041c4ee0>, signals=[15]) 2023-09-28T13:01:55.975 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-28T13:01:55.984 INFO:teuthology.task.internal:Opening connections... 2023-09-28T13:01:55.984 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T13:01:55.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:01:56.051 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-28T13:01:56.058 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-09-28T13:01:56.074 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-09-28T13:01:56.074 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.4" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-09-28T13:01:56.130 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T13:01:56.131 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T13:01:56.132 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-09-28T13:01:56.150 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-28T13:01:56.159 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-28T13:01:56.165 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-28T13:01:56.165 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2023-09-28T13:01:56.185 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-28T13:01:56.192 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-28T13:01:56.192 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2023-09-28T13:01:56.240 INFO:teuthology.orchestra.run.smithi069.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-09-28T13:01:56.241 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-28T13:01:56.274 INFO:teuthology.run_tasks:Running task kernel... 2023-09-28T13:01:56.291 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-28T13:01:56.291 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-28T13:01:56.291 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-28T13:01:56.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T13:01:56.306 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-09-28T13:01:56.361 INFO:teuthology.orchestra.run.smithi069.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-09-28T13:01:56.361 INFO:teuthology.task.kernel:Running kernel on smithi069: 4.18.0-305.25.1.el8_4.x86_64 2023-09-28T13:01:56.361 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum install -y kernel 2023-09-28T13:01:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:01:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-09-28T13:01:59.205 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 36 kB/s | 3.5 kB 00:00 2023-09-28T13:02:00.442 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-09-28T13:02:03.792 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-09-28T13:02:04.461 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-09-28T13:02:04.461 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-09-28T13:02:04.462 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-09-28T13:02:04.605 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:02:04.606 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:02:04.606 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:02:04.702 DEBUG:teuthology.orchestra.run.smithi069:> echo no | sudo yum reinstall kernel || true 2023-09-28T13:02:05.044 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:02:05.045 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-09-28T13:02:05.342 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:02 ago on Thu 28 Sep 2023 01:02:03 PM UTC. 2023-09-28T13:02:05.489 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-28T13:02:05.489 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T13:02:05.489 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T13:02:05.516 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-09-28T13:02:05.565 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum reinstall -y kernel || true 2023-09-28T13:02:05.906 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:02:05.906 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-09-28T13:02:06.202 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:03 ago on Thu 28 Sep 2023 01:02:03 PM UTC. 2023-09-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T13:02:06.366 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-09-28T13:02:06.420 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2023-09-28T13:02:06.544 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-28T13:02:06.544 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-28T13:02:06.545 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-09-28T13:02:06.545 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-28T13:02:06.545 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-28T13:02:06.545 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-28T13:02:06.545 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi069.front.sepia.ceph.com, path=None, version=distro) 2023-09-28T13:02:06.545 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2023-09-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-28T13:02:06.669 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-28T13:02:06.670 DEBUG:teuthology.orchestra.run.smithi069:> sudo rpm -qi grub2-tools 2023-09-28T13:02:06.696 INFO:teuthology.orchestra.run.smithi069.stdout:Name : grub2-tools 2023-09-28T13:02:06.696 INFO:teuthology.orchestra.run.smithi069.stdout:Epoch : 1 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Version : 2.02 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Release : 99.el8_4.1 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Architecture: x86_64 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Group : System Environment/Base 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Size : 9264631 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:License : GPLv3+ 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-09-28T13:02:06.697 INFO:teuthology.orchestra.run.smithi069.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:Relocations : (not relocatable) 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:Packager : Red Hat, Inc. 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:Vendor : Red Hat, Inc. 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:Summary : Support tools for GRUB. 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:Description : 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout:hardware devices. 2023-09-28T13:02:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:02:06.699 INFO:teuthology.orchestra.run.smithi069.stdout:This subpackage provides tools for support of all platforms. 2023-09-28T13:02:06.699 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-28T13:02:06.699 INFO:teuthology.task.kernel:Updating grub on smithi069 to boot 4.18.0-425.3.1.el8.x86_64 2023-09-28T13:02:06.700 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-28T13:02:08.135 INFO:teuthology.orchestra.run.smithi069.stderr:Generating grub configuration file ... 2023-09-28T13:02:10.053 INFO:teuthology.orchestra.run.smithi069.stderr:done 2023-09-28T13:02:10.054 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-09-28T13:02:10.072 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.ikr0n8TVtv 2023-09-28T13:02:10.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ikr0n8TVtv 2023-09-28T13:02:10.142 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.ikr0n8TVtv 2023-09-28T13:02:10.288 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.ikr0n8TVtv is 6KB 2023-09-28T13:02:10.336 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.ikr0n8TVtv 2023-09-28T13:02:10.350 DEBUG:teuthology.orchestra.run.smithi069:> sudo /bin/ls /boot/loader/entries || true 2023-09-28T13:02:10.415 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-09-28T13:02:10.415 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-09-28T13:02:10.415 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-09-28T13:02:10.415 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-09-28T13:02:10.416 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-09-28T13:02:10.566 DEBUG:teuthology.orchestra.run.smithi069:> sudo shutdown -r now 2023-09-28T13:02:40.599 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-28T13:02:40.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T13:02:40.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:03:15.066 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-28T13:03:24.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T13:03:24.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:03:42.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-28T13:03:54.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T13:03:54.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:03:54.769 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-09-28T13:03:55.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T13:03:55.016 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-09-28T13:03:55.016 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-09-28T13:03:55.029 INFO:teuthology.orchestra.run.smithi069.stdout:4.18.0-425.3.1.el8.x86_64 2023-09-28T13:03:55.030 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-09-28T13:03:55.030 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-28T13:03:55.030 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-28T13:03:56.031 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-28T13:03:56.031 DEBUG:teuthology.orchestra.run.smithi069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-28T13:03:56.153 INFO:teuthology.orchestra.run.smithi069.stdout:ttyS1 2023-09-28T13:03:56.168 DEBUG:teuthology.parallel:result is None 2023-09-28T13:03:56.168 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-28T13:03:56.175 INFO:teuthology.task.internal:Creating test directory... 2023-09-28T13:03:56.175 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-28T13:03:56.189 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-28T13:03:56.195 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-28T13:03:56.205 INFO:teuthology.task.internal:Creating archive directory... 2023-09-28T13:03:56.206 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-28T13:03:56.246 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-28T13:03:56.252 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-28T13:03:56.253 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-28T13:03:56.320 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T13:03:56.331 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T13:03:56.332 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-28T13:03:56.339 INFO:teuthology.task.internal:Configuring sudo... 2023-09-28T13:03:56.339 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-28T13:03:56.395 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-28T13:03:56.403 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-28T13:03:56.403 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-28T13:03:56.450 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T13:03:56.529 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T13:03:56.567 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T13:03:56.647 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T13:03:56.683 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:03:56.684 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-28T13:03:56.748 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2023-09-28T13:03:56.870 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T13:03:57.287 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-28T13:03:57.294 INFO:teuthology.task.internal:Starting timer... 2023-09-28T13:03:57.294 INFO:teuthology.run_tasks:Running task pcp... 2023-09-28T13:03:57.303 INFO:teuthology.run_tasks:Running task selinux... 2023-09-28T13:03:57.313 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-28T13:03:57.313 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2023-09-28T13:03:57.382 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: [ OK ] 2023-09-28T13:03:57.383 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-28T13:03:57.383 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2023-09-28T13:03:57.411 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2023-09-28T13:03:57.412 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive'} 2023-09-28T13:03:57.412 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T13:03:57.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T13:03:57.475 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-28T13:03:57.476 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2023-09-28T13:03:57.549 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-28T13:03:57.559 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-28T13:03:57.564 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-28T13:03:57.699 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-28T13:03:57.713 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-28T13:03:57.714 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-28T13:11:55.617 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com')] 2023-09-28T13:11:55.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T13:11:55.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:11:55.685 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-09-28T13:11:55.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T13:11:55.707 INFO:teuthology.run_tasks:Running task clock... 2023-09-28T13:11:55.719 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-28T13:11:55.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-28T13:11:55.720 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T13:11:55.775 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-28T13:11:55.789 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-28T13:11:55.831 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2023-09-28T13:11:55.841 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2023-09-28T13:11:55.854 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-28T13:11:55.868 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-28T13:11:55.941 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-09-28T13:11:55.944 INFO:teuthology.orchestra.run.smithi069.stdout:210 Number of sources = 4 2023-09-28T13:11:55.944 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T13:11:55.944 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-09-28T13:11:55.944 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T13:11:55.944 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T13:11:55.945 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T13:11:55.945 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T13:11:55.945 INFO:teuthology.run_tasks:Running task install... 2023-09-28T13:11:55.960 DEBUG:teuthology.task.install:project ceph 2023-09-28T13:11:55.960 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba'}} 2023-09-28T13:11:55.960 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba'} 2023-09-28T13:11:55.960 INFO:teuthology.task.install:Using flavor: default 2023-09-28T13:11:55.966 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-28T13:11:55.966 INFO:teuthology.task.install:extra packages: [] 2023-09-28T13:11:55.967 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba', 'tag': None, 'wait_for_package': False} 2023-09-28T13:11:55.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2c186684db7f9ea0cdb098fc86b350a0fdd26eba 2023-09-28T13:11:56.190 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-09-27-0919-quincy/2c186684db7f9ea0cdb098fc86b350a0fdd26eba/centos/8/flavors/default/ 2023-09-28T13:11:56.190 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1143.g2c186684 2023-09-28T13:11:56.359 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-09-27-0919-quincy/2c186684db7f9ea0cdb098fc86b350a0fdd26eba/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-09-27-0919-quincy/2c186684db7f9ea0cdb098fc86b350a0fdd26eba/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-09-27-0919-quincy/2c186684db7f9ea0cdb098fc86b350a0fdd26eba/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-28T13:11:56.359 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:11:56.360 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-28T13:11:56.385 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-09-28T13:11:56.385 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2c186684db7f9ea0cdb098fc86b350a0fdd26eba/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-28T13:11:56.452 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-28T13:11:56.525 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-28T13:11:56.589 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2023-09-28T13:11:56.590 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2023-09-28T13:11:56.979 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:11:57.279 INFO:teuthology.orchestra.run.smithi069.stdout:44 files removed 2023-09-28T13:11:57.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw 2023-09-28T13:11:57.680 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:11:58.378 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 283 kB/s | 78 kB 00:00 2023-09-28T13:11:58.663 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-09-28T13:11:58.877 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 7.9 kB/s | 1.5 kB 00:00 2023-09-28T13:11:58.987 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-09-28T13:11:59.568 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-09-28T13:12:02.840 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-09-28T13:12:03.204 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 116 MB/s | 33 MB 00:00 2023-09-28T13:12:08.556 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 122 MB/s | 38 MB 00:00 2023-09-28T13:12:17.192 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:12:17.194 INFO:teuthology.orchestra.run.smithi069.stdout:==================================================================================================== 2023-09-28T13:12:17.194 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:12:17.194 INFO:teuthology.orchestra.run.smithi069.stdout:==================================================================================================== 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:17.2.6-1143.g2c186684.el8 ceph 17 M 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:17.2.6-1143.g2c186684.el8 ceph 3.5 M 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:17.2.6-1143.g2c186684.el8 ceph 3.6 M 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:17.2.6-1143.g2c186684.el8 ceph 5.2 M 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:17.2.6-1143.g2c186684.el8 ceph 23 M 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:17.2.6-1143.g2c186684.el8 ceph 24 k 2023-09-28T13:12:17.195 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:17.2.6-1143.g2c186684.el8 ceph 796 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:17.2.6-1143.g2c186684.el8 ceph 506 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:17.2.6-1143.g2c186684.el8 ceph 5.5 M 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:17.2.6-1143.g2c186684.el8 ceph 45 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:17.2.6-1143.g2c186684.el8 ceph 115 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:17.2.6-1143.g2c186684.el8 ceph 191 k 2023-09-28T13:12:17.196 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:17.2.6-1143.g2c186684.el8 ceph 370 k 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:17.2.6-1143.g2c186684.el8 ceph 358 k 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:17.2.6-1143.g2c186684.el8 ceph 106 k 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout:==================================================================================================== 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout:Install 21 Packages 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 2 Packages 2023-09-28T13:12:17.197 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:12:17.198 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 63 M 2023-09-28T13:12:17.198 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:12:18.937 INFO:teuthology.orchestra.run.smithi069.stdout:(1/23): ceph-common-17.2.6-1143.g2c186684.el8.x 14 MB/s | 23 MB 00:01 2023-09-28T13:12:19.061 INFO:teuthology.orchestra.run.smithi069.stdout:(2/23): ceph-radosgw-17.2.6-1143.g2c186684.el8. 9.3 MB/s | 17 MB 00:01 2023-09-28T13:12:19.061 INFO:teuthology.orchestra.run.smithi069.stdout:(3/23): ceph-selinux-17.2.6-1143.g2c186684.el8. 195 kB/s | 24 kB 00:00 2023-09-28T13:12:19.118 INFO:teuthology.orchestra.run.smithi069.stdout:(4/23): libradosstriper1-17.2.6-1143.g2c186684. 8.8 MB/s | 506 kB 00:00 2023-09-28T13:12:19.120 INFO:teuthology.orchestra.run.smithi069.stdout:(5/23): libcephfs2-17.2.6-1143.g2c186684.el8.x8 13 MB/s | 796 kB 00:00 2023-09-28T13:12:19.168 INFO:teuthology.orchestra.run.smithi069.stdout:(6/23): python3-ceph-argparse-17.2.6-1143.g2c18 939 kB/s | 45 kB 00:00 2023-09-28T13:12:19.213 INFO:teuthology.orchestra.run.smithi069.stdout:(7/23): python3-ceph-common-17.2.6-1143.g2c1866 2.5 MB/s | 115 kB 00:00 2023-09-28T13:12:19.261 INFO:teuthology.orchestra.run.smithi069.stdout:(8/23): python3-cephfs-17.2.6-1143.g2c186684.el 3.9 MB/s | 191 kB 00:00 2023-09-28T13:12:19.316 INFO:teuthology.orchestra.run.smithi069.stdout:(9/23): python3-rados-17.2.6-1143.g2c186684.el8 6.7 MB/s | 370 kB 00:00 2023-09-28T13:12:19.368 INFO:teuthology.orchestra.run.smithi069.stdout:(10/23): librgw2-17.2.6-1143.g2c186684.el8.x86_ 22 MB/s | 5.5 MB 00:00 2023-09-28T13:12:19.371 INFO:teuthology.orchestra.run.smithi069.stdout:(11/23): python3-rbd-17.2.6-1143.g2c186684.el8. 6.4 MB/s | 358 kB 00:00 2023-09-28T13:12:19.390 INFO:teuthology.orchestra.run.smithi069.stdout:(12/23): python3-rgw-17.2.6-1143.g2c186684.el8. 4.9 MB/s | 106 kB 00:00 2023-09-28T13:12:19.880 INFO:teuthology.orchestra.run.smithi069.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 120 kB/s | 59 kB 00:00 2023-09-28T13:12:20.037 INFO:teuthology.orchestra.run.smithi069.stdout:(14/23): libunwind-1.3.1-3.el8.x86_64.rpm 478 kB/s | 75 kB 00:00 2023-09-28T13:12:20.087 INFO:teuthology.orchestra.run.smithi069.stdout:(15/23): gperftools-libs-2.7-9.el8.x86_64.rpm 428 kB/s | 306 kB 00:00 2023-09-28T13:12:20.121 INFO:teuthology.orchestra.run.smithi069.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 1.3 MB/s | 44 kB 00:00 2023-09-28T13:12:20.136 INFO:teuthology.orchestra.run.smithi069.stdout:(17/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 17 MB/s | 259 kB 00:00 2023-09-28T13:12:20.152 INFO:teuthology.orchestra.run.smithi069.stdout:(18/23): librdkafka-0.11.4-1.el8.x86_64.rpm 22 MB/s | 353 kB 00:00 2023-09-28T13:12:20.165 INFO:teuthology.orchestra.run.smithi069.stdout:(19/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.7 MB/s | 47 kB 00:00 2023-09-28T13:12:20.564 INFO:teuthology.orchestra.run.smithi069.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 3.3 MB/s | 1.7 MB 00:00 2023-09-28T13:12:20.813 INFO:teuthology.orchestra.run.smithi069.stdout:(21/23): librados2-17.2.6-1143.g2c186684.el8.x8 5.3 MB/s | 3.5 MB 00:00 2023-09-28T13:12:21.097 INFO:teuthology.orchestra.run.smithi069.stdout:(22/23): librbd1-17.2.6-1143.g2c186684.el8.x86_ 6.7 MB/s | 3.6 MB 00:00 2023-09-28T13:12:21.140 INFO:teuthology.orchestra.run.smithi069.stdout:(23/23): ceph-base-17.2.6-1143.g2c186684.el8.x8 1.3 MB/s | 5.2 MB 00:03 2023-09-28T13:12:21.145 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:12:21.145 INFO:teuthology.orchestra.run.smithi069.stdout:Total 16 MB/s | 63 MB 00:03 2023-09-28T13:12:21.149 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:12:21.193 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:12:21.193 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:12:21.942 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:12:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:12:23.068 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:12:23.260 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-09-28T13:12:23.631 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-09-28T13:12:23.877 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:17.2.6-1143.g2c186684.el8.x86_64 2/25 2023-09-28T13:12:23.964 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:17.2.6-1143.g2c186684.el8.x86_64 2/25 2023-09-28T13:12:24.166 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:17.2.6-1143.g2c186684.el8.x86_64 3/25 2023-09-28T13:12:24.432 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2023-09-28T13:12:24.660 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:17.2.6-1143.g2c186684.el8.x86_64 5/25 2023-09-28T13:12:25.048 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:17.2.6-1143.g2c186684.el8.x86_64 5/25 2023-09-28T13:12:25.260 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:17.2.6-1143.g2c186684.el8.x86_64 6/25 2023-09-28T13:12:25.320 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:17.2.6-1143.g2c186684.el8.x86_64 6/25 2023-09-28T13:12:25.529 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2023-09-28T13:12:25.760 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2023-09-28T13:12:25.965 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2023-09-28T13:12:26.618 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/25 2023-09-28T13:12:26.785 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:17.2.6-1143.g2c186684.el8.x86_64 10/25 2023-09-28T13:12:26.836 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:17.2.6-1143.g2c186684.el8.x86_64 10/25 2023-09-28T13:12:26.987 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:17.2.6-1143.g2c186684.el8. 11/25 2023-09-28T13:12:27.179 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:17.2.6-1143.g2c186684.el8.x86_64 12/25 2023-09-28T13:12:27.387 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:17.2.6-1143.g2c186684.el8.x86_64 13/25 2023-09-28T13:12:27.630 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:17.2.6-1143.g2c186684.el8.x86_64 14/25 2023-09-28T13:12:27.768 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:17.2.6-1143.g2c186684.el8.x86_6 15/25 2023-09-28T13:12:27.848 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1143.g2c186684.el8.x86_6 15/25 2023-09-28T13:12:28.028 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-09-28T13:12:28.206 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2023-09-28T13:12:28.488 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-09-28T13:12:28.693 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:17.2.6-1143.g2c186684.el8.x8 19/25 2023-09-28T13:12:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:17.2.6-1143.g2c186684.el8.x86_64 20/25 2023-09-28T13:12:33.859 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:17.2.6-1143.g2c186684.el8.x86_64 20/25 2023-09-28T13:12:34.443 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:17.2.6-1143.g2c186684.el8.x86_64 20/25 2023-09-28T13:12:34.792 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:17.2.6-1143.g2c186684.el8.x86_64 21/25 2023-09-28T13:12:34.871 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:17.2.6-1143.g2c186684.el8.x86_64 21/25 2023-09-28T13:12:35.025 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:17.2.6-1143.g2c186684.el8.x86_64 22/25 2023-09-28T13:12:52.558 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1143.g2c186684.el8.x86_64 22/25 2023-09-28T13:12:52.558 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2023-09-28T13:12:52.558 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /run 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-09-28T13:12:52.559 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:12:54.255 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:17.2.6-1143.g2c186684.el8.x86_64 23/25 2023-09-28T13:12:54.320 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1143.g2c186684.el8.x86_64 23/25 2023-09-28T13:12:54.321 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-09-28T13:12:54.524 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-09-28T13:12:54.524 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:17.2.6-1143.g2c186684.el8.x86_64 1/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:17.2.6-1143.g2c186684.el8.x86_64 2/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:17.2.6-1143.g2c186684.el8.x86_64 3/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:17.2.6-1143.g2c186684.el8.x86_64 4/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:17.2.6-1143.g2c186684.el8.x86_64 5/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:17.2.6-1143.g2c186684.el8.x86_6 6/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:17.2.6-1143.g2c186684.el8.x86_64 7/25 2023-09-28T13:12:55.283 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1143.g2c186684.el8. 8/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:17.2.6-1143.g2c186684.el8.x8 9/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:17.2.6-1143.g2c186684.el8.x86_64 10/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:17.2.6-1143.g2c186684.el8.x86_64 11/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:17.2.6-1143.g2c186684.el8.x86_64 12/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:17.2.6-1143.g2c186684.el8.x86_64 13/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 19/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 20/25 2023-09-28T13:12:55.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-09-28T13:12:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:17.2.6-1143.g2c186684.el8.x86_64 22/25 2023-09-28T13:12:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-09-28T13:12:55.285 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:17.2.6-1143.g2c186684.el8.x86_64 24/25 2023-09-28T13:12:56.778 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-09-28T13:12:56.778 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:48 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:12:58.658 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:12:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-28T13:12:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-28T13:12:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:12:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-28T13:12:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:12:58.782 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:12:58.912 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-test 2023-09-28T13:12:59.275 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:13:00.140 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:52 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:01.927 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:13:01.928 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2023-09-28T13:13:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:13:01.928 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2023-09-28T13:13:01.928 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:17.2.6-1143.g2c186684.el8 ceph 52 M 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:17.2.6-1143.g2c186684.el8 ceph 175 k 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout:Install 6 Packages 2023-09-28T13:13:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:01.930 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 53 M 2023-09-28T13:13:01.930 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 233 M 2023-09-28T13:13:01.930 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:13:01.935 INFO:teuthology.orchestra.run.smithi069.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-09-28T13:13:01.973 INFO:teuthology.orchestra.run.smithi069.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 4.1 MB/s | 161 kB 00:00 2023-09-28T13:13:01.988 INFO:teuthology.orchestra.run.smithi069.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-09-28T13:13:02.004 INFO:teuthology.orchestra.run.smithi069.stdout:(4/6): socat-1.7.3.3-2.el8.x86_64.rpm 19 MB/s | 302 kB 00:00 2023-09-28T13:13:02.091 INFO:teuthology.orchestra.run.smithi069.stdout:(5/6): libcephsqlite-17.2.6-1143.g2c186684.el8. 1.1 MB/s | 175 kB 00:00 2023-09-28T13:13:04.327 INFO:teuthology.orchestra.run.smithi069.stdout:(6/6): ceph-test-17.2.6-1143.g2c186684.el8.x86_ 22 MB/s | 52 MB 00:02 2023-09-28T13:13:04.330 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:13:04.330 INFO:teuthology.orchestra.run.smithi069.stdout:Total 22 MB/s | 53 MB 00:02 2023-09-28T13:13:04.334 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:13:04.357 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:13:04.358 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:13:04.696 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:13:04.700 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:13:05.212 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:13:05.425 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2023-09-28T13:13:05.637 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2023-09-28T13:13:05.720 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2023-09-28T13:13:05.889 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2023-09-28T13:13:06.082 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-09-28T13:13:06.262 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:17.2.6-1143.g2c186684.el8.x86_64 5/6 2023-09-28T13:13:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1143.g2c186684.el8.x86_64 5/6 2023-09-28T13:13:11.547 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:17.2.6-1143.g2c186684.el8.x86_64 6/6 2023-09-28T13:13:11.794 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-test-2:17.2.6-1143.g2c186684.el8.x86_64 6/6 2023-09-28T13:13:11.794 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:17.2.6-1143.g2c186684.el8.x86_64 1/6 2023-09-28T13:13:11.794 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:17.2.6-1143.g2c186684.el8.x86_64 2/6 2023-09-28T13:13:11.794 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-09-28T13:13:11.794 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2023-09-28T13:13:11.794 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-09-28T13:13:12.934 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2023-09-28T13:13:12.935 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:04 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:14.795 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:13:14.891 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:14.891 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:13:14.891 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:14.891 INFO:teuthology.orchestra.run.smithi069.stdout: jq-1.5-12.el8.x86_64 2023-09-28T13:13:14.892 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:14.892 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-28T13:13:14.892 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.3.3-2.el8.x86_64 2023-09-28T13:13:14.892 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-28T13:13:14.892 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:14.892 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:13:15.002 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph 2023-09-28T13:13:15.354 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:13:16.215 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:08 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:18.067 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:13:18.070 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================================= 2023-09-28T13:13:18.070 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:13:18.070 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================================= 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:17.2.6-1143.g2c186684.el8 ceph 6.4 k 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:17.2.6-1143.g2c186684.el8 ceph 2.3 M 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:17.2.6-1143.g2c186684.el8 ceph 1.6 M 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 238 k 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:17.2.6-1143.g2c186684.el8 ceph 3.9 M 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:17.2.6-1143.g2c186684.el8 ceph 17 M 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-28T13:13:18.071 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-28T13:13:18.072 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================================= 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout:Install 28 Packages 2023-09-28T13:13:18.073 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:18.074 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 27 M 2023-09-28T13:13:18.074 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 106 M 2023-09-28T13:13:18.074 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:13:18.408 INFO:teuthology.orchestra.run.smithi069.stdout:(1/28): ceph-17.2.6-1143.g2c186684.el8.x86_64.r 43 kB/s | 6.4 kB 00:00 2023-09-28T13:13:18.527 INFO:teuthology.orchestra.run.smithi069.stdout:(2/28): ceph-mds-17.2.6-1143.g2c186684.el8.x86_ 8.5 MB/s | 2.3 MB 00:00 2023-09-28T13:13:19.033 INFO:teuthology.orchestra.run.smithi069.stdout:(3/28): ceph-mgr-17.2.6-1143.g2c186684.el8.x86_ 2.0 MB/s | 1.6 MB 00:00 2023-09-28T13:13:19.124 INFO:teuthology.orchestra.run.smithi069.stdout:(4/28): ceph-mgr-modules-core-17.2.6-1143.g2c18 2.6 MB/s | 238 kB 00:00 2023-09-28T13:13:19.328 INFO:teuthology.orchestra.run.smithi069.stdout:(5/28): ceph-osd-17.2.6-1143.g2c186684.el8.x86_ 21 MB/s | 17 MB 00:00 2023-09-28T13:13:19.458 INFO:teuthology.orchestra.run.smithi069.stdout:(6/28): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 131 kB/s | 44 kB 00:00 2023-09-28T13:13:19.616 INFO:teuthology.orchestra.run.smithi069.stdout:(7/28): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2023-09-28T13:13:19.662 INFO:teuthology.orchestra.run.smithi069.stdout:(8/28): ceph-mon-17.2.6-1143.g2c186684.el8.x86_ 3.1 MB/s | 3.9 MB 00:01 2023-09-28T13:13:19.662 INFO:teuthology.orchestra.run.smithi069.stdout:(9/28): python3-beautifulsoup4-4.6.3-2.el8.1.no 556 kB/s | 185 kB 00:00 2023-09-28T13:13:19.711 INFO:teuthology.orchestra.run.smithi069.stdout:(10/28): python3-jaraco-6.2-6.el8.noarch.rpm 224 kB/s | 11 kB 00:00 2023-09-28T13:13:19.746 INFO:teuthology.orchestra.run.smithi069.stdout:(11/28): python3-cherrypy-18.4.0-1.el8.noarch.r 2.9 MB/s | 384 kB 00:00 2023-09-28T13:13:19.772 INFO:teuthology.orchestra.run.smithi069.stdout:(12/28): python3-logutils-0.3.5-11.el8.noarch.r 866 kB/s | 49 kB 00:00 2023-09-28T13:13:19.862 INFO:teuthology.orchestra.run.smithi069.stdout:(13/28): python3-jaraco-functools-2.0-4.el8.noa 88 kB/s | 18 kB 00:00 2023-09-28T13:13:19.872 INFO:teuthology.orchestra.run.smithi069.stdout:(14/28): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-09-28T13:13:19.921 INFO:teuthology.orchestra.run.smithi069.stdout:(15/28): python3-simplegeneric-0.8.1-17.el8.noa 383 kB/s | 19 kB 00:00 2023-09-28T13:13:19.923 INFO:teuthology.orchestra.run.smithi069.stdout:(16/28): python3-portend-2.6-1.el8.noarch.rpm 255 kB/s | 16 kB 00:00 2023-09-28T13:13:19.952 INFO:teuthology.orchestra.run.smithi069.stdout:(17/28): python3-more-itertools-7.2.0-3.el8.noa 286 kB/s | 59 kB 00:00 2023-09-28T13:13:19.970 INFO:teuthology.orchestra.run.smithi069.stdout:(18/28): python3-singledispatch-3.4.0.3-18.el8. 489 kB/s | 24 kB 00:00 2023-09-28T13:13:19.999 INFO:teuthology.orchestra.run.smithi069.stdout:(19/28): python3-tempora-1.14.1-5.el8.noarch.rp 388 kB/s | 29 kB 00:00 2023-09-28T13:13:20.002 INFO:teuthology.orchestra.run.smithi069.stdout:(20/28): python3-trustme-0.6.0-4.el8.noarch.rpm 543 kB/s | 27 kB 00:00 2023-09-28T13:13:20.034 INFO:teuthology.orchestra.run.smithi069.stdout:(21/28): python3-waitress-1.4.3-1.el8.noarch.rp 3.9 MB/s | 255 kB 00:00 2023-09-28T13:13:20.057 INFO:teuthology.orchestra.run.smithi069.stdout:(22/28): python3-webtest-2.0.33-1.el8.noarch.rp 1.5 MB/s | 85 kB 00:00 2023-09-28T13:13:20.084 INFO:teuthology.orchestra.run.smithi069.stdout:(23/28): python3-zc-lockfile-2.0-2.el8.noarch.r 468 kB/s | 23 kB 00:00 2023-09-28T13:13:20.091 INFO:teuthology.orchestra.run.smithi069.stdout:(24/28): python3-werkzeug-0.12.2-4.el8.noarch.r 13 MB/s | 457 kB 00:00 2023-09-28T13:13:20.105 INFO:teuthology.orchestra.run.smithi069.stdout:(25/28): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-09-28T13:13:20.111 INFO:teuthology.orchestra.run.smithi069.stdout:(26/28): python3-markupsafe-0.23-19.el8.x86_64. 1.4 MB/s | 39 kB 00:00 2023-09-28T13:13:20.119 INFO:teuthology.orchestra.run.smithi069.stdout:(27/28): python3-pytz-2017.2-9.el8.noarch.rpm 4.1 MB/s | 54 kB 00:00 2023-09-28T13:13:20.186 INFO:teuthology.orchestra.run.smithi069.stdout:(28/28): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.3 MB/s | 251 kB 00:00 2023-09-28T13:13:20.191 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:13:20.192 INFO:teuthology.orchestra.run.smithi069.stdout:Total 13 MB/s | 27 MB 00:02 2023-09-28T13:13:20.196 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:13:20.231 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:13:20.232 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:13:20.616 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:13:20.620 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:13:21.658 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:13:21.894 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/28 2023-09-28T13:13:22.108 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/28 2023-09-28T13:13:22.322 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/28 2023-09-28T13:13:22.566 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/28 2023-09-28T13:13:22.873 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/28 2023-09-28T13:13:23.076 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/28 2023-09-28T13:13:23.290 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 7/28 2023-09-28T13:13:23.518 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 8/28 2023-09-28T13:13:23.683 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/28 2023-09-28T13:13:23.814 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 10/28 2023-09-28T13:13:23.995 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 11/28 2023-09-28T13:13:24.212 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 12/28 2023-09-28T13:13:24.348 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 13/28 2023-09-28T13:13:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 14/28 2023-09-28T13:13:24.788 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 15/28 2023-09-28T13:13:24.973 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 16/28 2023-09-28T13:13:25.221 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-2.6-1.el8.noarch 17/28 2023-09-28T13:13:25.440 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 18/28 2023-09-28T13:13:25.644 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/28 2023-09-28T13:13:25.961 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 20/28 2023-09-28T13:13:26.219 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 21/28 2023-09-28T13:13:26.514 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 22/28 2023-09-28T13:13:26.848 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1143.g2c186684.el8. 23/28 2023-09-28T13:13:27.033 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:17.2.6-1143.g2c186684.el8.x86_64 24/28 2023-09-28T13:13:28.530 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1143.g2c186684.el8.x86_64 24/28 2023-09-28T13:13:28.724 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:17.2.6-1143.g2c186684.el8.x86_64 25/28 2023-09-28T13:13:29.119 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:17.2.6-1143.g2c186684.el8.x86_64 25/28 2023-09-28T13:13:29.283 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:17.2.6-1143.g2c186684.el8.x86_64 26/28 2023-09-28T13:13:29.506 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:17.2.6-1143.g2c186684.el8.x86_64 26/28 2023-09-28T13:13:29.634 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:17.2.6-1143.g2c186684.el8.x86_64 27/28 2023-09-28T13:13:29.652 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:17.2.6-1143.g2c186684.el8.x86_64 27/28 2023-09-28T13:13:29.808 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:17.2.6-1143.g2c186684.el8.x86_64 28/28 2023-09-28T13:13:30.215 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-2:17.2.6-1143.g2c186684.el8.x86_64 28/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:17.2.6-1143.g2c186684.el8.x86_64 1/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:17.2.6-1143.g2c186684.el8.x86_64 2/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:17.2.6-1143.g2c186684.el8.x86_64 3/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:17.2.6-1143.g2c186684.el8.x86_64 4/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:17.2.6-1143.g2c186684.el8.x86_64 5/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1143.g2c186684.el8. 6/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/28 2023-09-28T13:13:30.216 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/28 2023-09-28T13:13:30.217 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/28 2023-09-28T13:13:30.218 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/28 2023-09-28T13:13:30.218 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/28 2023-09-28T13:13:30.218 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/28 2023-09-28T13:13:30.218 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/28 2023-09-28T13:13:30.218 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/28 2023-09-28T13:13:30.218 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/28 2023-09-28T13:13:31.792 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/28 2023-09-28T13:13:31.792 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:23 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:33.779 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:13:33.879 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:33.879 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:13:33.879 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:33.879 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:33.879 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:33.879 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-28T13:13:33.880 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-2.6-1.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-28T13:13:33.881 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-28T13:13:33.882 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:33.882 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:13:34.019 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-base 2023-09-28T13:13:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:13:35.275 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:27 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:36.592 INFO:teuthology.orchestra.run.smithi069.stdout:Package ceph-base-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:13:37.081 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:13:37.082 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:13:37.082 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:13:37.177 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install cephadm 2023-09-28T13:13:37.539 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:13:38.625 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:30 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:40.430 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 80 k 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:13:40.431 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:40.432 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 80 k 2023-09-28T13:13:40.432 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 363 k 2023-09-28T13:13:40.432 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:13:40.654 INFO:teuthology.orchestra.run.smithi069.stdout:cephadm-17.2.6-1143.g2c186684.el8.noarch.rpm 360 kB/s | 80 kB 00:00 2023-09-28T13:13:40.654 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:13:40.655 INFO:teuthology.orchestra.run.smithi069.stdout:Total 358 kB/s | 80 kB 00:00 2023-09-28T13:13:40.655 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:13:40.663 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:13:40.663 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:13:40.665 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:13:40.669 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:13:40.743 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:13:43.520 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:17.2.6-1143.g2c186684.el8.noarch 1/1 2023-09-28T13:13:44.686 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:17.2.6-1143.g2c186684.el8.noarch 1/1 2023-09-28T13:13:44.932 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:17.2.6-1143.g2c186684.el8.noarch 1/1 2023-09-28T13:13:46.124 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:17.2.6-1143.g2c186684.el8.noarch 1/1 2023-09-28T13:13:46.125 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:38 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:48.019 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:13:48.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:48.116 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:13:48.116 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:13:48.116 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:48.116 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:13:48.243 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-immutable-object-cache 2023-09-28T13:13:48.621 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:13:49.574 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:41 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:51.470 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:13:51.471 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1143.g2c186684.el8 ceph 161 k 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:13:51.472 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:51.473 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 161 k 2023-09-28T13:13:51.473 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 490 k 2023-09-28T13:13:51.473 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:13:51.731 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-immutable-object-cache-17.2.6-1143.g2c1866 624 kB/s | 161 kB 00:00 2023-09-28T13:13:51.731 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:13:51.731 INFO:teuthology.orchestra.run.smithi069.stdout:Total 621 kB/s | 161 kB 00:00 2023-09-28T13:13:51.732 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:13:51.745 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:13:51.745 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:13:51.799 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:13:51.803 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:13:51.953 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:13:52.089 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1143.g2c186684. 1/1 2023-09-28T13:13:52.471 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1143.g2c186684. 1/1 2023-09-28T13:13:53.479 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1143.g2c186684. 1/1 2023-09-28T13:13:53.479 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:45 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:55.428 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:13:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:55.526 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:13:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:13:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:13:55.526 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:13:55.647 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr 2023-09-28T13:13:56.013 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:13:56.911 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:48 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:13:58.264 INFO:teuthology.orchestra.run.smithi069.stdout:Package ceph-mgr-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:13:58.743 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:13:58.745 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:13:58.745 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:13:58.861 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-dashboard 2023-09-28T13:13:59.222 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:14:00.143 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:52 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:02.416 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:14:02.417 INFO:teuthology.orchestra.run.smithi069.stdout:=================================================================================================== 2023-09-28T13:14:02.417 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:14:02.417 INFO:teuthology.orchestra.run.smithi069.stdout:=================================================================================================== 2023-09-28T13:14:02.417 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 1.7 M 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 23 k 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 14 k 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout:=================================================================================================== 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout:Install 6 Packages 2023-09-28T13:14:02.418 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:02.419 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 2.0 M 2023-09-28T13:14:02.419 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 8.0 M 2023-09-28T13:14:02.419 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:14:02.684 INFO:teuthology.orchestra.run.smithi069.stdout:(1/6): ceph-grafana-dashboards-17.2.6-1143.g2c1 208 kB/s | 23 kB 00:00 2023-09-28T13:14:02.688 INFO:teuthology.orchestra.run.smithi069.stdout:(2/6): ceph-prometheus-alerts-17.2.6-1143.g2c18 126 kB/s | 14 kB 00:00 2023-09-28T13:14:02.805 INFO:teuthology.orchestra.run.smithi069.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 279 kB/s | 34 kB 00:00 2023-09-28T13:14:02.840 INFO:teuthology.orchestra.run.smithi069.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-09-28T13:14:02.891 INFO:teuthology.orchestra.run.smithi069.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 970 kB/s | 196 kB 00:00 2023-09-28T13:14:03.086 INFO:teuthology.orchestra.run.smithi069.stdout:(6/6): ceph-mgr-dashboard-17.2.6-1143.g2c186684 3.3 MB/s | 1.7 MB 00:00 2023-09-28T13:14:03.088 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:14:03.088 INFO:teuthology.orchestra.run.smithi069.stdout:Total 3.0 MB/s | 2.0 MB 00:00 2023-09-28T13:14:03.090 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:14:03.098 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:14:03.098 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:14:03.179 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:14:03.183 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:14:03.448 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:14:03.645 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-09-28T13:14:03.828 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-09-28T13:14:03.973 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-09-28T13:14:04.143 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1143.g2c186684.el8.n 4/6 2023-09-28T13:14:04.497 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1143.g2c186684.el8. 5/6 2023-09-28T13:14:04.752 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1143.g2c186684.el8.noarc 6/6 2023-09-28T13:14:05.017 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1143.g2c186684.el8.noarc 6/6 2023-09-28T13:14:05.017 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1143.g2c186684.el8. 1/6 2023-09-28T13:14:05.017 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1143.g2c186684.el8.noarc 2/6 2023-09-28T13:14:05.018 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1143.g2c186684.el8.n 3/6 2023-09-28T13:14:05.018 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-09-28T13:14:05.018 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-09-28T13:14:06.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-09-28T13:14:06.047 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:58 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:08.430 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:14:08.527 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:08.527 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:14:08.527 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:14:08.527 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:14:08.527 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:14:08.527 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-28T13:14:08.527 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-28T13:14:08.528 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-28T13:14:08.528 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:08.528 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:14:08.637 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-diskprediction-local 2023-09-28T13:14:09.000 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:14:09.891 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:01 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:11.702 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================================================== 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================================================== 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 7.4 M 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-09-28T13:14:11.704 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================================================== 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout:Install 8 Packages 2023-09-28T13:14:11.705 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:11.706 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 36 M 2023-09-28T13:14:11.706 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 199 M 2023-09-28T13:14:11.706 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:14:11.758 INFO:teuthology.orchestra.run.smithi069.stdout:(1/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 4.2 MB/s | 225 kB 00:00 2023-09-28T13:14:11.823 INFO:teuthology.orchestra.run.smithi069.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 58 MB/s | 3.7 MB 00:00 2023-09-28T13:14:11.904 INFO:teuthology.orchestra.run.smithi069.stdout:(3/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 58 MB/s | 4.7 MB 00:00 2023-09-28T13:14:12.035 INFO:teuthology.orchestra.run.smithi069.stdout:(4/8): python3-scipy-1.0.0-20.module+el8.1.0+33 44 MB/s | 15 MB 00:00 2023-09-28T13:14:12.052 INFO:teuthology.orchestra.run.smithi069.stdout:(5/8): libquadmath-8.4.1-1.el8.x86_64.rpm 10 MB/s | 169 kB 00:00 2023-09-28T13:14:12.077 INFO:teuthology.orchestra.run.smithi069.stdout:(6/8): libgfortran-8.4.1-1.el8.x86_64.rpm 25 MB/s | 639 kB 00:00 2023-09-28T13:14:12.089 INFO:teuthology.orchestra.run.smithi069.stdout:(7/8): openblas-0.3.12-1.el8.x86_64.rpm 25 MB/s | 4.6 MB 00:00 2023-09-28T13:14:12.809 INFO:teuthology.orchestra.run.smithi069.stdout:(8/8): ceph-mgr-diskprediction-local-17.2.6-114 6.7 MB/s | 7.4 MB 00:01 2023-09-28T13:14:12.811 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:14:12.811 INFO:teuthology.orchestra.run.smithi069.stdout:Total 33 MB/s | 36 MB 00:01 2023-09-28T13:14:12.821 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:14:12.840 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:14:12.840 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:14:13.284 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:14:13.288 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:14:13.888 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:14:14.085 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2023-09-28T13:14:14.223 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2023-09-28T13:14:14.383 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2023-09-28T13:14:14.940 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2023-09-28T13:14:15.135 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-09-28T13:14:15.657 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-09-28T13:14:15.843 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2023-09-28T13:14:16.563 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2023-09-28T13:14:16.894 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2023-09-28T13:14:17.101 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-09-28T13:14:19.162 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-09-28T13:14:20.428 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2023-09-28T13:14:20.600 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1143.g2c18668 8/8 2023-09-28T13:14:20.922 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1143.g2c18668 8/8 2023-09-28T13:14:20.922 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1143.g2c18668 1/8 2023-09-28T13:14:20.922 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 2/8 2023-09-28T13:14:20.922 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 3/8 2023-09-28T13:14:20.922 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2023-09-28T13:14:20.922 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 5/8 2023-09-28T13:14:20.923 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 6/8 2023-09-28T13:14:20.923 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 7/8 2023-09-28T13:14:21.964 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 8/8 2023-09-28T13:14:21.964 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:13 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:23.883 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:14:23.984 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:23.984 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:14:23.984 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:14:23.985 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-09-28T13:14:23.985 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-09-28T13:14:23.985 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.12-1.el8.x86_64 2023-09-28T13:14:23.985 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-09-28T13:14:23.985 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-09-28T13:14:23.985 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-09-28T13:14:23.985 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-09-28T13:14:23.986 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:23.986 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:14:24.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-rook 2023-09-28T13:14:24.503 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:14:25.625 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:17 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:27.423 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:14:27.424 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================================== 2023-09-28T13:14:27.424 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================================== 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 47 k 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-28T13:14:27.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================================== 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout:Install 13 Packages 2023-09-28T13:14:27.426 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:27.427 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 1.9 M 2023-09-28T13:14:27.427 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 25 M 2023-09-28T13:14:27.427 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:14:27.880 INFO:teuthology.orchestra.run.smithi069.stdout:(1/13): ceph-mgr-rook-17.2.6-1143.g2c186684.el8 360 kB/s | 47 kB 00:00 2023-09-28T13:14:28.144 INFO:teuthology.orchestra.run.smithi069.stdout:(2/13): python3-certifi-2018.10.15-7.el8.noarch 41 kB/s | 16 kB 00:00 2023-09-28T13:14:28.176 INFO:teuthology.orchestra.run.smithi069.stdout:(3/13): python3-cachetools-3.1.1-4.el8.noarch.r 77 kB/s | 33 kB 00:00 2023-09-28T13:14:28.379 INFO:teuthology.orchestra.run.smithi069.stdout:(4/13): python3-rsa-4.9-2.el8.noarch.rpm 316 kB/s | 64 kB 00:00 2023-09-28T13:14:28.410 INFO:teuthology.orchestra.run.smithi069.stdout:(5/13): python3-google-auth-1.1.1-10.el8.noarch 153 kB/s | 81 kB 00:00 2023-09-28T13:14:28.515 INFO:teuthology.orchestra.run.smithi069.stdout:(6/13): python3-websocket-client-0.56.0-5.el8.n 453 kB/s | 61 kB 00:00 2023-09-28T13:14:28.535 INFO:teuthology.orchestra.run.smithi069.stdout:(7/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 214 kB/s | 27 kB 00:00 2023-09-28T13:14:28.583 INFO:teuthology.orchestra.run.smithi069.stdout:(8/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.3 MB/s | 110 kB 00:00 2023-09-28T13:14:28.591 INFO:teuthology.orchestra.run.smithi069.stdout:(9/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-09-28T13:14:28.612 INFO:teuthology.orchestra.run.smithi069.stdout:(10/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 7.2 MB/s | 155 kB 00:00 2023-09-28T13:14:28.652 INFO:teuthology.orchestra.run.smithi069.stdout:(11/13): python3-jsonpointer-1.10-11.el8.noarch 288 kB/s | 20 kB 00:00 2023-09-28T13:14:28.682 INFO:teuthology.orchestra.run.smithi069.stdout:(12/13): python3-requests-oauthlib-1.0.0-1.el8. 614 kB/s | 43 kB 00:00 2023-09-28T13:14:28.772 INFO:teuthology.orchestra.run.smithi069.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.9 MB/s | 1.2 MB 00:00 2023-09-28T13:14:28.776 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:14:28.777 INFO:teuthology.orchestra.run.smithi069.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2023-09-28T13:14:28.782 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:14:28.797 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:14:28.797 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:14:28.884 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:14:28.888 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:14:29.379 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:14:29.637 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-09-28T13:14:29.864 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/13 2023-09-28T13:14:30.150 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-09-28T13:14:30.422 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-09-28T13:14:30.664 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-09-28T13:14:30.857 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-09-28T13:14:31.078 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-09-28T13:14:31.325 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-09-28T13:14:31.553 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-09-28T13:14:31.807 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-09-28T13:14:32.947 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-09-28T13:14:33.276 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-09-28T13:14:33.448 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:17.2.6-1143.g2c186684.el8.noarch 13/13 2023-09-28T13:14:33.712 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1143.g2c186684.el8.noarch 13/13 2023-09-28T13:14:33.712 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1143.g2c186684.el8.noarch 1/13 2023-09-28T13:14:33.713 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-09-28T13:14:33.713 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-09-28T13:14:33.713 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-09-28T13:14:33.713 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-09-28T13:14:33.713 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/13 2023-09-28T13:14:33.713 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-09-28T13:14:33.713 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 8/13 2023-09-28T13:14:33.714 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 9/13 2023-09-28T13:14:33.714 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 10/13 2023-09-28T13:14:33.714 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-09-28T13:14:33.714 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2023-09-28T13:14:34.792 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2023-09-28T13:14:34.792 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:26 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:36.945 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:14:37.046 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:37.046 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:14:37.046 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-28T13:14:37.047 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-28T13:14:37.048 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-28T13:14:37.048 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:37.048 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:14:37.178 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-cephadm 2023-09-28T13:14:37.547 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:14:38.555 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:30 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:40.338 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:14:40.339 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================================== 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================================== 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 121 k 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-28T13:14:40.340 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:40.341 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:14:40.341 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================================== 2023-09-28T13:14:40.341 INFO:teuthology.orchestra.run.smithi069.stdout:Install 5 Packages 2023-09-28T13:14:40.341 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:40.342 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 6.0 M 2023-09-28T13:14:40.342 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 26 M 2023-09-28T13:14:40.342 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:14:40.491 INFO:teuthology.orchestra.run.smithi069.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 707 kB/s | 60 kB 00:00 2023-09-28T13:14:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 3.2 MB/s | 476 kB 00:00 2023-09-28T13:14:40.559 INFO:teuthology.orchestra.run.smithi069.stdout:(3/5): ceph-mgr-cephadm-17.2.6-1143.g2c186684.e 788 kB/s | 121 kB 00:00 2023-09-28T13:14:40.587 INFO:teuthology.orchestra.run.smithi069.stdout:(4/5): python3-babel-2.5.1-5.el8.noarch.rpm 50 MB/s | 4.8 MB 00:00 2023-09-28T13:14:40.592 INFO:teuthology.orchestra.run.smithi069.stdout:(5/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 13 MB/s | 538 kB 00:00 2023-09-28T13:14:40.593 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:14:40.594 INFO:teuthology.orchestra.run.smithi069.stdout:Total 23 MB/s | 6.0 MB 00:00 2023-09-28T13:14:40.597 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:14:40.607 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:14:40.607 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:14:40.702 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:14:40.706 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:14:41.743 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:14:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/5 2023-09-28T13:14:42.309 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/5 2023-09-28T13:14:42.653 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-09-28T13:14:42.919 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-09-28T13:14:43.088 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1143.g2c186684.el8.noarch 5/5 2023-09-28T13:14:43.368 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1143.g2c186684.el8.noarch 5/5 2023-09-28T13:14:43.368 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1143.g2c186684.el8.noarch 1/5 2023-09-28T13:14:43.368 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-09-28T13:14:43.368 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-09-28T13:14:43.369 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/5 2023-09-28T13:14:44.391 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/5 2023-09-28T13:14:44.391 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:36 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:46.232 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.5.1-5.el8.noarch 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:46.333 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:14:46.457 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-fuse 2023-09-28T13:14:46.828 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:14:47.746 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:39 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:50.267 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:14:50.267 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:14:50.267 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout: x86_64 2:17.2.6-1143.g2c186684.el8 ceph 874 k 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout:Install 2 Packages 2023-09-28T13:14:50.268 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:50.269 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 957 k 2023-09-28T13:14:50.269 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 3.0 M 2023-09-28T13:14:50.269 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:14:50.337 INFO:teuthology.orchestra.run.smithi069.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-09-28T13:14:50.485 INFO:teuthology.orchestra.run.smithi069.stdout:(2/2): ceph-fuse-17.2.6-1143.g2c186684.el8.x86_ 3.9 MB/s | 874 kB 00:00 2023-09-28T13:14:50.486 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:14:50.486 INFO:teuthology.orchestra.run.smithi069.stdout:Total 4.3 MB/s | 957 kB 00:00 2023-09-28T13:14:50.488 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:14:50.509 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:14:50.509 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:14:50.593 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:14:50.597 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:14:50.873 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:14:51.139 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2023-09-28T13:14:51.329 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 2/2 2023-09-28T13:14:51.709 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 2/2 2023-09-28T13:14:51.709 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 1/2 2023-09-28T13:14:52.736 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-09-28T13:14:52.736 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:44 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:54.842 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:14:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:54.941 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:14:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-09-28T13:14:54.941 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:54.941 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:14:55.054 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-volume 2023-09-28T13:14:55.429 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:14:56.363 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:48 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:14:58.196 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:17.2.6-1143.g2c186684.el8 ceph-noarch 267 k 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:14:58.197 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 267 k 2023-09-28T13:14:58.198 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 1.3 M 2023-09-28T13:14:58.198 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:14:58.493 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-volume-17.2.6-1143.g2c186684.el8.noarch.rp 904 kB/s | 267 kB 00:00 2023-09-28T13:14:58.494 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:14:58.494 INFO:teuthology.orchestra.run.smithi069.stdout:Total 899 kB/s | 267 kB 00:00 2023-09-28T13:14:58.494 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:14:58.504 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:14:58.505 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:14:58.531 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:14:58.535 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:14:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:14:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:17.2.6-1143.g2c186684.el8.noarch 1/1 2023-09-28T13:14:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:17.2.6-1143.g2c186684.el8.noarch 1/1 2023-09-28T13:15:00.448 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:17.2.6-1143.g2c186684.el8.noarch 1/1 2023-09-28T13:15:00.448 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:52 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:02.479 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:15:02.576 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:02.576 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:15:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:17.2.6-1143.g2c186684.el8.noarch 2023-09-28T13:15:02.577 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:02.577 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:02.685 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install librados-devel 2023-09-28T13:15:03.060 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:03.928 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:55 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:05.781 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:05.781 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:05.781 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:17.2.6-1143.g2c186684.el8 ceph 130 k 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:15:05.782 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:05.783 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 130 k 2023-09-28T13:15:05.783 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 464 k 2023-09-28T13:15:05.783 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:15:06.231 INFO:teuthology.orchestra.run.smithi069.stdout:librados-devel-17.2.6-1143.g2c186684.el8.x86_64 289 kB/s | 130 kB 00:00 2023-09-28T13:15:06.232 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:15:06.233 INFO:teuthology.orchestra.run.smithi069.stdout:Total 288 kB/s | 130 kB 00:00 2023-09-28T13:15:06.233 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:15:06.240 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:15:06.240 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:15:06.297 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:15:06.301 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:15:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:15:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados-devel-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:07.902 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:07.903 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:02:59 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:09.880 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:15:09.976 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:09.976 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:15:09.976 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:15:09.976 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:09.977 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:10.083 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install libcephfs2 2023-09-28T13:15:10.454 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:11.381 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:03 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:12.727 INFO:teuthology.orchestra.run.smithi069.stdout:Package libcephfs2-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:15:13.202 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:13.203 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:15:13.203 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:13.298 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install libcephfs-devel 2023-09-28T13:15:13.668 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:14.514 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:06 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:17.2.6-1143.g2c186684.el8 ceph 25 k 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:15:16.380 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:16.381 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 25 k 2023-09-28T13:15:16.381 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 109 k 2023-09-28T13:15:16.381 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:15:16.492 INFO:teuthology.orchestra.run.smithi069.stdout:libcephfs-devel-17.2.6-1143.g2c186684.el8.x86_6 224 kB/s | 25 kB 00:00 2023-09-28T13:15:16.492 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:15:16.493 INFO:teuthology.orchestra.run.smithi069.stdout:Total 221 kB/s | 25 kB 00:00 2023-09-28T13:15:16.493 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:15:16.497 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:15:16.497 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:15:16.499 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:15:16.503 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:15:16.557 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:15:16.899 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:17.138 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs-devel-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:18.116 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:18.116 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:10 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:20.055 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:15:20.153 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:20.153 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:15:20.153 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:15:20.153 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:20.154 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:20.265 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install librados2 2023-09-28T13:15:20.634 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:21.482 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:13 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:22.884 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:15:23.360 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:23.361 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:15:23.361 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:23.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install librbd1 2023-09-28T13:15:23.841 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:24.680 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:16 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:26.067 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:15:26.542 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:26.543 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:15:26.543 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:26.646 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-rados 2023-09-28T13:15:27.016 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:27.933 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:19 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:29.316 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-rados-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:15:29.795 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:29.796 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:15:29.796 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:29.897 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-rgw 2023-09-28T13:15:30.267 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:31.158 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:23 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:32.524 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-rgw-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:15:32.996 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:32.997 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:15:32.998 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:33.089 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-cephfs 2023-09-28T13:15:33.458 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:34.348 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:26 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:35.740 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-cephfs-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:15:36.208 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:36.210 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:15:36.210 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:36.335 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-rbd 2023-09-28T13:15:36.707 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:37.697 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:29 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:39.073 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-rbd-2:17.2.6-1143.g2c186684.el8.x86_64 is already installed. 2023-09-28T13:15:39.548 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:39.549 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-09-28T13:15:39.549 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:39.651 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install rbd-fuse 2023-09-28T13:15:40.019 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:41.551 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:33 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:43.352 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2023-09-28T13:15:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:17.2.6-1143.g2c186684.el8 ceph 91 k 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 91 k 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 264 k 2023-09-28T13:15:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:15:43.576 INFO:teuthology.orchestra.run.smithi069.stdout:rbd-fuse-17.2.6-1143.g2c186684.el8.x86_64.rpm 408 kB/s | 91 kB 00:00 2023-09-28T13:15:43.576 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:15:43.577 INFO:teuthology.orchestra.run.smithi069.stdout:Total 405 kB/s | 91 kB 00:00 2023-09-28T13:15:43.577 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:15:43.589 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:15:43.589 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:15:43.645 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:15:43.649 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:15:43.763 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:15:43.969 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:44.242 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:45.304 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:45.305 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:37 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:49.991 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:15:50.086 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:50.087 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:15:50.087 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:15:50.087 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:50.087 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:15:50.200 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install rbd-mirror 2023-09-28T13:15:50.574 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:15:52.671 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:44 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:15:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:15:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:54.523 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2023-09-28T13:15:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:15:54.523 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:17.2.6-1143.g2c186684.el8 ceph 3.5 M 2023-09-28T13:15:54.523 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:15:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:15:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:15:54.524 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:15:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 3.5 M 2023-09-28T13:15:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 16 M 2023-09-28T13:15:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:15:54.996 INFO:teuthology.orchestra.run.smithi069.stdout:rbd-mirror-17.2.6-1143.g2c186684.el8.x86_64.rpm 7.3 MB/s | 3.5 MB 00:00 2023-09-28T13:15:54.997 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:15:54.997 INFO:teuthology.orchestra.run.smithi069.stdout:Total 7.3 MB/s | 3.5 MB 00:00 2023-09-28T13:15:54.998 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:15:55.011 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:15:55.011 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:15:55.080 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:15:55.084 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:15:55.526 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:15:55.710 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:56.150 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:57.278 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:15:57.278 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:49 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:16:02.045 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:16:02.142 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:02.142 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:16:02.142 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:16:02.142 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:02.142 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:16:02.267 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install rbd-nbd 2023-09-28T13:16:02.641 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-09-28T13:16:04.463 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:03:56 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:16:06.240 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-09-28T13:16:06.241 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:16:06.241 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2023-09-28T13:16:06.242 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:16:06.242 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-09-28T13:16:06.242 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:17.2.6-1143.g2c186684.el8 ceph 173 k 2023-09-28T13:16:06.242 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:06.242 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-09-28T13:16:06.243 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2023-09-28T13:16:06.243 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2023-09-28T13:16:06.243 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:06.243 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 173 k 2023-09-28T13:16:06.243 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 552 k 2023-09-28T13:16:06.243 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-09-28T13:16:06.692 INFO:teuthology.orchestra.run.smithi069.stdout:rbd-nbd-17.2.6-1143.g2c186684.el8.x86_64.rpm 384 kB/s | 173 kB 00:00 2023-09-28T13:16:06.692 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-09-28T13:16:06.693 INFO:teuthology.orchestra.run.smithi069.stdout:Total 383 kB/s | 173 kB 00:00 2023-09-28T13:16:06.693 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-09-28T13:16:06.706 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-09-28T13:16:06.706 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-09-28T13:16:06.761 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-09-28T13:16:06.766 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-09-28T13:16:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-09-28T13:16:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:16:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-nbd-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:16:08.394 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:17.2.6-1143.g2c186684.el8.x86_64 1/1 2023-09-28T13:16:08.394 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:04:00 ago on Thu 28 Sep 2023 01:12:08 PM UTC. 2023-09-28T13:16:11.738 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-09-28T13:16:11.838 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:11.838 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-09-28T13:16:11.838 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:17.2.6-1143.g2c186684.el8.x86_64 2023-09-28T13:16:11.838 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:11.838 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-09-28T13:16:11.946 DEBUG:teuthology.parallel:result is None 2023-09-28T13:16:11.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2c186684db7f9ea0cdb098fc86b350a0fdd26eba 2023-09-28T13:16:12.093 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-28T13:16:12.113 INFO:teuthology.orchestra.run.smithi069.stdout:17.2.6-1143.g2c186684.el8 2023-09-28T13:16:12.113 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1143.g2c186684.el8 2023-09-28T13:16:12.113 INFO:teuthology.task.install:The correct ceph version 17.2.6-1143.g2c186684 is installed. 2023-09-28T13:16:12.113 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-28T13:16:12.114 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:12.114 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-28T13:16:12.178 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-28T13:16:12.178 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:12.178 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2023-09-28T13:16:12.243 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-28T13:16:12.306 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-28T13:16:12.306 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:12.307 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-28T13:16:12.370 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-28T13:16:12.434 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-28T13:16:12.435 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:12.435 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2023-09-28T13:16:12.498 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-28T13:16:12.562 INFO:teuthology.run_tasks:Running task ceph... 2023-09-28T13:16:12.624 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-28T13:16:12.624 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /var/log/ceph 2023-09-28T13:16:12.647 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-28T13:16:12.648 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-28T13:16:12.711 INFO:tasks.ceph:Creating extra log directories... 2023-09-28T13:16:12.711 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-28T13:16:12.783 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-28T13:16:12.783 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-28T13:16:12.784 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802', 'branch': 'wip-yuri3-testing-2023-09-27-0919-quincy', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7403802', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-09-27-0919-quincy'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-09-27-0919-quincy', 'sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 1925, 'sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri3-testing-2023-09-27-0919-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '2c186684db7f9ea0cdb098fc86b350a0fdd26eba', 'targets': {'smithi069.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnJDlS/BXlSINjJJGcXbSPxbGrNZzdOVEDfBuvbD1N26QyGYGlNYw62XUaigjgXCvDWBhNHQtSmoc/xGP0IEDE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-27_19:28:09', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-28T13:16:12.784 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-28T13:16:12.830 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/run/ceph 2023-09-28T13:16:12.894 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:12.894 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2023-09-28T13:16:12.948 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-28T13:16:12.948 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2023-09-28T13:16:13.002 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-28T13:16:13.002 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T13:16:13.002 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 215929 Links: 1 2023-09-28T13:16:13.002 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T13:16:13.002 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T13:16:13.002 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-09-28 13:15:55.923970703 +0000 2023-09-28T13:16:13.002 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-09-28 13:11:26.621020173 +0000 2023-09-28T13:16:13.003 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-09-28 13:11:26.621020173 +0000 2023-09-28T13:16:13.003 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-09-28T13:16:13.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-28T13:16:13.065 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-09-28T13:16:13.065 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-09-28T13:16:13.065 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000249845 s, 2.0 MB/s 2023-09-28T13:16:13.066 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-28T13:16:13.123 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2023-09-28T13:16:13.178 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-28T13:16:13.178 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T13:16:13.178 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 217013 Links: 1 2023-09-28T13:16:13.178 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T13:16:13.178 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T13:16:13.179 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-09-28 13:15:55.923970703 +0000 2023-09-28T13:16:13.179 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-09-28 13:11:27.105009465 +0000 2023-09-28T13:16:13.179 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-09-28 13:11:27.105009465 +0000 2023-09-28T13:16:13.179 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-09-28T13:16:13.179 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-28T13:16:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-09-28T13:16:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-09-28T13:16:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000322189 s, 1.6 MB/s 2023-09-28T13:16:13.242 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-28T13:16:13.298 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2023-09-28T13:16:13.352 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-28T13:16:13.352 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T13:16:13.353 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 223239 Links: 1 2023-09-28T13:16:13.353 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T13:16:13.353 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T13:16:13.353 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-09-28 13:15:55.923970703 +0000 2023-09-28T13:16:13.353 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-09-28 13:11:27.596998580 +0000 2023-09-28T13:16:13.353 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-09-28 13:11:27.596998580 +0000 2023-09-28T13:16:13.353 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-09-28T13:16:13.353 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-28T13:16:13.415 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-09-28T13:16:13.416 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-09-28T13:16:13.416 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.00023831 s, 2.1 MB/s 2023-09-28T13:16:13.417 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-28T13:16:13.473 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2023-09-28T13:16:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-28T13:16:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T13:16:13.528 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 220357 Links: 1 2023-09-28T13:16:13.529 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T13:16:13.529 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T13:16:13.529 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-09-28 13:15:55.923970703 +0000 2023-09-28T13:16:13.529 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-09-28 13:11:28.089987674 +0000 2023-09-28T13:16:13.529 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-09-28 13:11:28.089987674 +0000 2023-09-28T13:16:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-09-28T13:16:13.529 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-28T13:16:13.591 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-09-28T13:16:13.591 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-09-28T13:16:13.591 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000189977 s, 2.7 MB/s 2023-09-28T13:16:13.592 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-28T13:16:13.648 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-28T13:16:13.648 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-09-28T13:16:13.648 INFO:tasks.ceph:Generating config... 2023-09-28T13:16:13.649 INFO:tasks.ceph:[client] rbd default format = 1 2023-09-28T13:16:13.649 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-09-28T13:16:13.649 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-09-28T13:16:13.649 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-09-28T13:16:13.649 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-28T13:16:13.649 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-28T13:16:13.650 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-28T13:16:13.650 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-28T13:16:13.650 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-28T13:16:13.650 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-28T13:16:13.651 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-09-28T13:16:13.651 INFO:tasks.ceph:Setting up mon.a... 2023-09-28T13:16:13.652 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-28T13:16:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.keyring 2023-09-28T13:16:13.739 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-28T13:16:13.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T13:16:13.842 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.69')] 2023-09-28T13:16:13.842 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.69', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2023-09-28T13:16:13.843 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:13.843 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T13:16:13.896 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.69 --print /home/ubuntu/cephtest/ceph.monmap 2023-09-28T13:16:13.972 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-28T13:16:13.972 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: generated fsid aea3e571-5f08-4258-b80b-a913c1bdff4d 2023-09-28T13:16:13.972 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = octopus 2023-09-28T13:16:13.972 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 0 2023-09-28T13:16:13.972 INFO:teuthology.orchestra.run.smithi069.stdout:fsid aea3e571-5f08-4258-b80b-a913c1bdff4d 2023-09-28T13:16:13.972 INFO:teuthology.orchestra.run.smithi069.stdout:last_changed 2023-09-28T13:16:13.972357+0000 2023-09-28T13:16:13.972 INFO:teuthology.orchestra.run.smithi069.stdout:created 2023-09-28T13:16:13.972357+0000 2023-09-28T13:16:13.973 INFO:teuthology.orchestra.run.smithi069.stdout:min_mon_release 15 (octopus) 2023-09-28T13:16:13.973 INFO:teuthology.orchestra.run.smithi069.stdout:election_strategy: 1 2023-09-28T13:16:13.973 INFO:teuthology.orchestra.run.smithi069.stdout:0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2023-09-28T13:16:13.973 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-09-28T13:16:13.974 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T13:16:14.028 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aea3e571-5f08-4258-b80b-a913c1bdff4d... 2023-09-28T13:16:14.030 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2023-09-28T13:16:14.109 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2023-09-28T13:16:14.110 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-28T13:16:14.111 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2023-09-28T13:16:14.112 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = 172.21.15.69 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: mon client directed command retry = 5 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on pool no app = False 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: ms inject socket failures = 5000 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = aea3e571-5f08-4258-b80b-a913c1bdff4d 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.113 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2023-09-28T13:16:14.114 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2023-09-28T13:16:14.115 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore allocator = stupid 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: osd shutdown pgref assert = True 2023-09-28T13:16:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-09-28T13:16:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.118 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2023-09-28T13:16:14.119 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout: rbd default format = 1 2023-09-28T13:16:14.120 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2023-09-28T13:16:14.121 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-28T13:16:14.121 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-28T13:16:14.212 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-28T13:16:14.212 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:14.213 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-28T13:16:14.227 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:14.227 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-28T13:16:14.281 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T13:16:14.281 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:14.281 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-28T13:16:14.281 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T13:16:14.354 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:14.354 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-28T13:16:14.409 INFO:tasks.ceph:Setting up mon nodes... 2023-09-28T13:16:14.409 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-28T13:16:14.409 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T13:16:14.497 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T13:16:14.499 INFO:tasks.ceph:Setting up mds nodes... 2023-09-28T13:16:14.499 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-28T13:16:14.500 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-28T13:16:14.537 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-28T13:16:14.549 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-28T13:16:14.550 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-09-28T13:16:14.550 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-28T13:16:14.613 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-28T13:16:14.614 INFO:tasks.ceph:role: osd.0 2023-09-28T13:16:14.614 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T13:16:14.614 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-28T13:16:14.685 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T13:16:14.685 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T13:16:14.685 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T13:16:14.685 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-09-28T13:16:14.685 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T13:16:14.685 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-09-28T13:16:14.686 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T13:16:14.686 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T13:16:14.686 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T13:16:14.686 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T13:16:15.112 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-09-28T13:16:15.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-09-28T13:16:15.114 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-28T13:16:15.300 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-28T13:16:15.329 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-28T13:16:15.394 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-28T13:16:15.394 INFO:tasks.ceph:role: osd.1 2023-09-28T13:16:15.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T13:16:15.394 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-28T13:16:15.466 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T13:16:15.466 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T13:16:15.466 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T13:16:15.467 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-09-28T13:16:15.467 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T13:16:15.467 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-09-28T13:16:15.467 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T13:16:15.467 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T13:16:15.467 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T13:16:15.467 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T13:16:15.888 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-09-28T13:16:15.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-09-28T13:16:15.890 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-28T13:16:15.994 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-28T13:16:16.022 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-28T13:16:16.087 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-28T13:16:16.087 INFO:tasks.ceph:role: osd.2 2023-09-28T13:16:16.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T13:16:16.087 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-28T13:16:16.157 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T13:16:16.157 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T13:16:16.158 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T13:16:16.602 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-09-28T13:16:16.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-09-28T13:16:16.604 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-28T13:16:16.733 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-28T13:16:16.762 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T13:16:16.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:16.849+0000 7f0999abd540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-28T13:16:16.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:16.852+0000 7f0999abd540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-28T13:16:16.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:16.852+0000 7f0999abd540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T13:16:16.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:16.852+0000 7f0999abd540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T13:16:16.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:16.852+0000 7f0999abd540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T13:16:16.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:16.857+0000 7f0999abd540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-28T13:16:17.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:17.382+0000 7f0999abd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:18.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:18.148+0000 7f0999abd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:18.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:18.914+0000 7f0999abd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:19.707 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-28T13:16:19.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T13:16:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:19.817+0000 7ff33200d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-28T13:16:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:19.817+0000 7ff33200d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-28T13:16:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:19.817+0000 7ff33200d540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T13:16:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:19.817+0000 7ff33200d540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T13:16:19.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:19.817+0000 7ff33200d540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T13:16:19.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:19.818+0000 7ff33200d540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-28T13:16:20.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:20.341+0000 7ff33200d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:21.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:21.105+0000 7ff33200d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:21.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:21.868+0000 7ff33200d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:22.661 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-28T13:16:22.727 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T13:16:22.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:22.808+0000 7fe59dbd3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-28T13:16:22.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:22.808+0000 7fe59dbd3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-28T13:16:22.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:22.808+0000 7fe59dbd3540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T13:16:22.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:22.808+0000 7fe59dbd3540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T13:16:22.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:22.808+0000 7fe59dbd3540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T13:16:22.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:22.809+0000 7fe59dbd3540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-28T13:16:23.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:23.330+0000 7fe59dbd3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:24.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:24.094+0000 7fe59dbd3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:24.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T13:16:24.855+0000 7fe59dbd3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T13:16:25.652 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-28T13:16:25.722 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-28T13:16:25.722 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:25.722 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-28T13:16:25.790 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:25.790 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-28T13:16:25.856 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:25.856 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-28T13:16:25.921 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:25.921 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-28T13:16:25.986 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:25.987 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-28T13:16:26.041 INFO:tasks.ceph:Adding keys to all mons... 2023-09-28T13:16:26.042 DEBUG:teuthology.orchestra.run.smithi069:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-28T13:16:26.104 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.x] 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCefBVlg3yvHRAAqw5iQnOB0A+9DXpH0QPdUA== 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.0] 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCgfBVl+AS8MhAAnFnttzvhJoUESz3YfhwQIA== 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.1] 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCjfBVlZhnNMBAACdNlOtI+Xl1wKGZw38NqCw== 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.2] 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCmfBVl+LFBMBAAGqxR1Y4Jy3XHWAlbI6ZrXw== 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-09-28T13:16:26.105 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCefBVlAD8RIBAAZsFqMbccV2Mjp5PiYqxOPg== 2023-09-28T13:16:26.106 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T13:16:26.194 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T13:16:26.240 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T13:16:26.287 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T13:16:26.334 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T13:16:26.383 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-28T13:16:26.383 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-28T13:16:26.407 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T13:16:26.498 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-28T13:16:26.522 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-28T13:16:26.576 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-28T13:16:26.576 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-28T13:16:26.577 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-28T13:16:26.619 INFO:tasks.ceph.mon.a:Started 2023-09-28T13:16:26.619 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-28T13:16:26.619 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-28T13:16:26.619 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-28T13:16:26.621 INFO:tasks.ceph.mgr.x:Started 2023-09-28T13:16:26.621 INFO:tasks.ceph:Setting crush tunables to default 2023-09-28T13:16:26.622 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd crush tunables default 2023-09-28T13:16:26.825 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2023-09-28T13:16:26.836 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-28T13:16:26.836 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:26.836 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-28T13:16:26.860 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:26.860 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-28T13:16:26.926 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:16:26.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-28T13:16:26.991 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new b96f86a3-12d6-49d3-9473-54ade67387c3 0 2023-09-28T13:16:27.240 INFO:teuthology.orchestra.run.smithi069.stdout:0 2023-09-28T13:16:27.252 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 7e69c7d9-132c-49cf-951d-75df98e19410 1 2023-09-28T13:16:27.480 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-09-28T13:16:27.492 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 9453f0c5-6252-492a-86fc-7e2ebb4f241e 2 2023-09-28T13:16:27.697 INFO:teuthology.orchestra.run.smithi069.stdout:2 2023-09-28T13:16:27.710 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-28T13:16:27.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-28T13:16:27.712 INFO:tasks.ceph.osd.0:Started 2023-09-28T13:16:27.712 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-28T13:16:27.712 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-28T13:16:27.714 INFO:tasks.ceph.osd.1:Started 2023-09-28T13:16:27.714 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-28T13:16:27.714 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-28T13:16:27.716 INFO:tasks.ceph.osd.2:Started 2023-09-28T13:16:27.717 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T13:16:27.917 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:27.917 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T13:16:27.695585+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T13:16:27.930 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-28T13:16:27.930 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-28T13:16:28.139 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:28.138+0000 7faa3e8ff180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-28T13:16:28.232 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T13:16:28.273 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:28.272+0000 7faa3e8ff180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-28T13:16:28.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:16:28.326+0000 7fab2e4ab540 -1 Falling back to public interface 2023-09-28T13:16:28.327 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-09-28T13:16:28.326+0000 7ffa86163540 -1 Falling back to public interface 2023-09-28T13:16:28.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:16:28.335+0000 7f96ffcc9540 -1 Falling back to public interface 2023-09-28T13:16:28.358 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:28.357+0000 7faa3e8ff180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-28T13:16:28.416 INFO:teuthology.misc.health.smithi069.stdout: 2023-09-28T13:16:28.416 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":5,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T13:16:27.695585+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T13:16:28.427 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-09-28T13:16:28.547 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:28.547+0000 7faa3e8ff180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-28T13:16:28.720 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:28.719+0000 7faa3e8ff180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-28T13:16:28.797 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:28.797+0000 7faa3e8ff180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-28T13:16:28.936 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:28.936+0000 7faa3e8ff180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-28T13:16:29.031 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:29.030+0000 7faa3e8ff180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-28T13:16:29.545 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:29.544+0000 7faa3e8ff180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-28T13:16:29.622 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:29.621+0000 7faa3e8ff180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-28T13:16:29.700 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:29.699+0000 7faa3e8ff180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-28T13:16:30.272 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:30.272+0000 7faa3e8ff180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-28T13:16:30.409 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:30.408+0000 7faa3e8ff180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-28T13:16:30.492 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:30.491+0000 7faa3e8ff180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-28T13:16:30.737 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:30.736+0000 7faa3e8ff180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-28T13:16:30.820 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:30.820+0000 7faa3e8ff180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-28T13:16:31.673 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:31.672+0000 7faa3e8ff180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-28T13:16:31.747 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:31.746+0000 7faa3e8ff180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-28T13:16:31.822 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:31.821+0000 7faa3e8ff180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-28T13:16:31.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:16:31.834+0000 7fab2e4ab540 -1 osd.1 0 log_to_monitors true 2023-09-28T13:16:31.861 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-09-28T13:16:31.861+0000 7ffa86163540 -1 osd.2 0 log_to_monitors true 2023-09-28T13:16:31.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:16:31.880+0000 7f96ffcc9540 -1 osd.0 0 log_to_monitors true 2023-09-28T13:16:31.960 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:31.960+0000 7faa3e8ff180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-28T13:16:32.045 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:32.045+0000 7faa3e8ff180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-28T13:16:32.197 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:32.197+0000 7faa3e8ff180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-28T13:16:32.273 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:32.273+0000 7faa3e8ff180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-28T13:16:32.350 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:32.350+0000 7faa3e8ff180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-28T13:16:32.426 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:32.426+0000 7faa3e8ff180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-28T13:16:33.445 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-09-28T13:16:33.445+0000 7fa9f7d02700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-09-28T13:16:34.730 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T13:16:35.196 INFO:teuthology.misc.health.smithi069.stdout: 2023-09-28T13:16:35.197 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":7,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T13:16:33.705785+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T13:16:35.215 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-09-28T13:16:35.459 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-09-28T13:16:35.459+0000 7ffa7cd84700 -1 osd.2 0 waiting for initial osdmap 2023-09-28T13:16:35.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:16:35.464+0000 7fab268cf700 -1 osd.1 0 waiting for initial osdmap 2023-09-28T13:16:35.468 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-09-28T13:16:35.468+0000 7ffa75b7b700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T13:16:35.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:16:35.471+0000 7fab1dec3700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T13:16:35.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:16:35.482+0000 7f96f68ea700 -1 osd.0 0 waiting for initial osdmap 2023-09-28T13:16:35.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:16:35.490+0000 7f96ef6e1700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T13:16:41.518 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T13:16:41.828 INFO:teuthology.misc.health.smithi069.stdout: 2023-09-28T13:16:41.828 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":12,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T13:16:40.727999+0000","last_up_change":"2023-09-28T13:16:36.467615+0000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T13:16:38.484517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":86628},{"type":"v1","addr":"172.21.15.69:6817","nonce":86628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":86628},{"type":"v1","addr":"172.21.15.69:6819","nonce":86628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":86628},{"type":"v1","addr":"172.21.15.69:6823","nonce":86628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":86628},{"type":"v1","addr":"172.21.15.69:6821","nonce":86628}]},"public_addr":"172.21.15.69:6817/86628","cluster_addr":"172.21.15.69:6819/86628","heartbeat_back_addr":"172.21.15.69:6823/86628","heartbeat_front_addr":"172.21.15.69:6821/86628","state":["exists","up"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":86604},{"type":"v1","addr":"172.21.15.69:6801","nonce":86604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":86604},{"type":"v1","addr":"172.21.15.69:6803","nonce":86604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":86604},{"type":"v1","addr":"172.21.15.69:6807","nonce":86604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":86604},{"type":"v1","addr":"172.21.15.69:6805","nonce":86604}]},"public_addr":"172.21.15.69:6801/86604","cluster_addr":"172.21.15.69:6803/86604","heartbeat_back_addr":"172.21.15.69:6807/86604","heartbeat_front_addr":"172.21.15.69:6805/86604","state":["exists","up"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":86605},{"type":"v1","addr":"172.21.15.69:6809","nonce":86605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":86605},{"type":"v1","addr":"172.21.15.69:6811","nonce":86605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":86605},{"type":"v1","addr":"172.21.15.69:6815","nonce":86605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":86605},{"type":"v1","addr":"172.21.15.69:6813","nonce":86605}]},"public_addr":"172.21.15.69:6809/86605","cluster_addr":"172.21.15.69:6811/86605","heartbeat_back_addr":"172.21.15.69:6815/86605","heartbeat_front_addr":"172.21.15.69:6813/86605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.888190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.815570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.891847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T13:16:41.841 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-09-28T13:16:41.841 INFO:tasks.ceph:Creating RBD pool 2023-09-28T13:16:41.841 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-28T13:16:42.746 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'rbd' created 2023-09-28T13:16:42.758 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-28T13:16:43.750 INFO:teuthology.orchestra.run.smithi069.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-28T13:16:43.761 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-28T13:16:43.761 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-28T13:16:43.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-28T13:16:43.762 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-28T13:16:43.762 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-28T13:16:44.121 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:44.133 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":86266},{"type":"v1","addr":"172.21.15.69:6825","nonce":86266}]},"active_addr":"172.21.15.69:6825/86266","active_change":"2023-09-28T13:16:32.440089+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":1098324693}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2717265374}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":4123132226}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3855535492}]}]} 2023-09-28T13:16:44.138 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-28T13:16:44.139 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-28T13:16:44.139 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T13:16:44.445 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:44.445 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":14,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T13:16:43.740001+0000","last_up_change":"2023-09-28T13:16:36.467615+0000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T13:16:38.484517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T13:16:42.162780+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":86628},{"type":"v1","addr":"172.21.15.69:6817","nonce":86628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":86628},{"type":"v1","addr":"172.21.15.69:6819","nonce":86628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":86628},{"type":"v1","addr":"172.21.15.69:6823","nonce":86628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":86628},{"type":"v1","addr":"172.21.15.69:6821","nonce":86628}]},"public_addr":"172.21.15.69:6817/86628","cluster_addr":"172.21.15.69:6819/86628","heartbeat_back_addr":"172.21.15.69:6823/86628","heartbeat_front_addr":"172.21.15.69:6821/86628","state":["exists","up"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":86604},{"type":"v1","addr":"172.21.15.69:6801","nonce":86604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":86604},{"type":"v1","addr":"172.21.15.69:6803","nonce":86604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":86604},{"type":"v1","addr":"172.21.15.69:6807","nonce":86604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":86604},{"type":"v1","addr":"172.21.15.69:6805","nonce":86604}]},"public_addr":"172.21.15.69:6801/86604","cluster_addr":"172.21.15.69:6803/86604","heartbeat_back_addr":"172.21.15.69:6807/86604","heartbeat_front_addr":"172.21.15.69:6805/86604","state":["exists","up"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":86605},{"type":"v1","addr":"172.21.15.69:6809","nonce":86605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":86605},{"type":"v1","addr":"172.21.15.69:6811","nonce":86605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":86605},{"type":"v1","addr":"172.21.15.69:6815","nonce":86605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":86605},{"type":"v1","addr":"172.21.15.69:6813","nonce":86605}]},"public_addr":"172.21.15.69:6809/86605","cluster_addr":"172.21.15.69:6811/86605","heartbeat_back_addr":"172.21.15.69:6815/86605","heartbeat_front_addr":"172.21.15.69:6813/86605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.888190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.815570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.891847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T13:16:44.459 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-28T13:16:44.459 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T13:16:44.765 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:44.765 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T13:16:44.743302+0000","last_up_change":"2023-09-28T13:16:36.467615+0000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T13:16:38.484517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T13:16:42.162780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":86628},{"type":"v1","addr":"172.21.15.69:6817","nonce":86628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":86628},{"type":"v1","addr":"172.21.15.69:6819","nonce":86628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":86628},{"type":"v1","addr":"172.21.15.69:6823","nonce":86628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":86628},{"type":"v1","addr":"172.21.15.69:6821","nonce":86628}]},"public_addr":"172.21.15.69:6817/86628","cluster_addr":"172.21.15.69:6819/86628","heartbeat_back_addr":"172.21.15.69:6823/86628","heartbeat_front_addr":"172.21.15.69:6821/86628","state":["exists","up"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":86604},{"type":"v1","addr":"172.21.15.69:6801","nonce":86604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":86604},{"type":"v1","addr":"172.21.15.69:6803","nonce":86604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":86604},{"type":"v1","addr":"172.21.15.69:6807","nonce":86604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":86604},{"type":"v1","addr":"172.21.15.69:6805","nonce":86604}]},"public_addr":"172.21.15.69:6801/86604","cluster_addr":"172.21.15.69:6803/86604","heartbeat_back_addr":"172.21.15.69:6807/86604","heartbeat_front_addr":"172.21.15.69:6805/86604","state":["exists","up"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":86605},{"type":"v1","addr":"172.21.15.69:6809","nonce":86605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":86605},{"type":"v1","addr":"172.21.15.69:6811","nonce":86605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":86605},{"type":"v1","addr":"172.21.15.69:6815","nonce":86605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":86605},{"type":"v1","addr":"172.21.15.69:6813","nonce":86605}]},"public_addr":"172.21.15.69:6809/86605","cluster_addr":"172.21.15.69:6811/86605","heartbeat_back_addr":"172.21.15.69:6815/86605","heartbeat_front_addr":"172.21.15.69:6813/86605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.888190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.815570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.891847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T13:16:44.779 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-28T13:16:44.779 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-28T13:16:44.780 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-28T13:16:44.935 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2023-09-28T13:16:44.936 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T13:16:44.943 INFO:teuthology.orchestra.run.smithi069.stdout:34359738372 2023-09-28T13:16:44.943 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T13:16:44.944 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2023-09-28T13:16:44.944 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T13:16:45.260 INFO:teuthology.orchestra.run.smithi069.stdout:34359738373 2023-09-28T13:16:45.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-09-28T13:16:45.308 INFO:teuthology.orchestra.run.smithi069.stdout:34359738373 2023-09-28T13:16:45.320 INFO:teuthology.orchestra.run.smithi069.stdout:34359738371 2023-09-28T13:16:45.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2023-09-28T13:16:45.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2023-09-28T13:16:46.279 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T13:16:46.323 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T13:16:46.335 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T13:16:46.614 INFO:teuthology.orchestra.run.smithi069.stdout:34359738373 2023-09-28T13:16:46.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-09-28T13:16:46.650 INFO:teuthology.orchestra.run.smithi069.stdout:34359738373 2023-09-28T13:16:46.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2023-09-28T13:16:46.692 INFO:teuthology.orchestra.run.smithi069.stdout:34359738371 2023-09-28T13:16:46.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2023-09-28T13:16:47.628 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T13:16:47.664 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T13:16:47.707 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T13:16:47.966 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2023-09-28T13:16:47.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2023-09-28T13:16:47.980 DEBUG:teuthology.parallel:result is None 2023-09-28T13:16:48.025 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2023-09-28T13:16:48.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2023-09-28T13:16:48.039 DEBUG:teuthology.parallel:result is None 2023-09-28T13:16:48.057 INFO:teuthology.orchestra.run.smithi069.stdout:34359738372 2023-09-28T13:16:48.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2023-09-28T13:16:48.071 DEBUG:teuthology.parallel:result is None 2023-09-28T13:16:48.071 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T13:16:48.071 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T13:16:48.415 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:48.417 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T13:16:48.428 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-09-28T13:16:46.445747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25356,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":23616,"kb_avail":283090164,"statfs":{"total":289910292480,"available":289884327936,"internally_reserved":0,"allocated":1564672,"data_stored":1284846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24182784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000731"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756894+0000","last_change":"2023-09-28T13:16:43.752228+0000","last_active":"2023-09-28T13:16:43.756894+0000","last_peered":"2023-09-28T13:16:43.756894+0000","last_clean":"2023-09-28T13:16:43.756894+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T13:16:43.756894+0000","last_undegraded":"2023-09-28T13:16:43.756894+0000","last_fullsized":"2023-09-28T13:16:43.756894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756901+0000","last_change":"2023-09-28T13:16:43.752332+0000","last_active":"2023-09-28T13:16:43.756901+0000","last_peered":"2023-09-28T13:16:43.756901+0000","last_clean":"2023-09-28T13:16:43.756901+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T13:16:43.756901+0000","last_undegraded":"2023-09-28T13:16:43.756901+0000","last_fullsized":"2023-09-28T13:16:43.756901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756930+0000","last_change":"2023-09-28T13:16:43.753014+0000","last_active":"2023-09-28T13:16:43.756930+0000","last_peered":"2023-09-28T13:16:43.756930+0000","last_clean":"2023-09-28T13:16:43.756930+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T13:16:43.756930+0000","last_undegraded":"2023-09-28T13:16:43.756930+0000","last_fullsized":"2023-09-28T13:16:43.756930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.749657+0000","last_change":"2023-09-28T13:16:43.749657+0000","last_active":"2023-09-28T13:16:43.749657+0000","last_peered":"2023-09-28T13:16:43.749657+0000","last_clean":"2023-09-28T13:16:43.749657+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T13:16:43.749657+0000","last_undegraded":"2023-09-28T13:16:43.749657+0000","last_fullsized":"2023-09-28T13:16:43.749657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:25:43.877047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":139,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.747458+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T13:16:43.747458+0000","last_peered":"2023-09-28T13:16:43.747458+0000","last_clean":"2023-09-28T13:16:43.747458+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T13:16:43.747458+0000","last_undegraded":"2023-09-28T13:16:43.747458+0000","last_fullsized":"2023-09-28T13:16:43.747458+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.754413+0000","last_change":"2023-09-28T13:16:43.749815+0000","last_active":"2023-09-28T13:16:43.754413+0000","last_peered":"2023-09-28T13:16:43.754413+0000","last_clean":"2023-09-28T13:16:43.754413+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T13:16:43.754413+0000","last_undegraded":"2023-09-28T13:16:43.754413+0000","last_fullsized":"2023-09-28T13:16:43.754413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.749669+0000","last_change":"2023-09-28T13:16:43.749669+0000","last_active":"2023-09-28T13:16:43.749669+0000","last_peered":"2023-09-28T13:16:43.749669+0000","last_clean":"2023-09-28T13:16:43.749669+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T13:16:43.749669+0000","last_undegraded":"2023-09-28T13:16:43.749669+0000","last_fullsized":"2023-09-28T13:16:43.749669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:32:03.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.752514+0000","last_change":"2023-09-28T13:16:43.752514+0000","last_active":"2023-09-28T13:16:43.752514+0000","last_peered":"2023-09-28T13:16:43.752514+0000","last_clean":"2023-09-28T13:16:43.752514+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T13:16:43.752514+0000","last_undegraded":"2023-09-28T13:16:43.752514+0000","last_fullsized":"2023-09-28T13:16:43.752514+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756914+0000","last_change":"2023-09-28T13:16:43.752733+0000","last_active":"2023-09-28T13:16:43.756914+0000","last_peered":"2023-09-28T13:16:43.756914+0000","last_clean":"2023-09-28T13:16:43.756914+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T13:16:43.756914+0000","last_undegraded":"2023-09-28T13:16:43.756914+0000","last_fullsized":"2023-09-28T13:16:43.756914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7744,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364096,"statfs":{"total":96636764160,"available":96628834304,"internally_reserved":0,"allocated":122880,"data_stored":33548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8896,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94362944,"statfs":{"total":96636764160,"available":96627654656,"internally_reserved":0,"allocated":716800,"data_stored":623916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":724992,"data_stored":627382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T13:16:48.429 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T13:16:48.730 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T13:16:48.743 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-09-28T13:16:48.446108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25176,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":23616,"kb_avail":283090344,"statfs":{"total":289910292480,"available":289884512256,"internally_reserved":0,"allocated":1572864,"data_stored":1288312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24182784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001093"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756894+0000","last_change":"2023-09-28T13:16:43.752228+0000","last_active":"2023-09-28T13:16:43.756894+0000","last_peered":"2023-09-28T13:16:43.756894+0000","last_clean":"2023-09-28T13:16:43.756894+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T13:16:43.756894+0000","last_undegraded":"2023-09-28T13:16:43.756894+0000","last_fullsized":"2023-09-28T13:16:43.756894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756901+0000","last_change":"2023-09-28T13:16:43.752332+0000","last_active":"2023-09-28T13:16:43.756901+0000","last_peered":"2023-09-28T13:16:43.756901+0000","last_clean":"2023-09-28T13:16:43.756901+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T13:16:43.756901+0000","last_undegraded":"2023-09-28T13:16:43.756901+0000","last_fullsized":"2023-09-28T13:16:43.756901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756930+0000","last_change":"2023-09-28T13:16:43.753014+0000","last_active":"2023-09-28T13:16:43.756930+0000","last_peered":"2023-09-28T13:16:43.756930+0000","last_clean":"2023-09-28T13:16:43.756930+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T13:16:43.756930+0000","last_undegraded":"2023-09-28T13:16:43.756930+0000","last_fullsized":"2023-09-28T13:16:43.756930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.751981+0000","last_change":"2023-09-28T13:16:43.749657+0000","last_active":"2023-09-28T13:16:43.751981+0000","last_peered":"2023-09-28T13:16:43.751981+0000","last_clean":"2023-09-28T13:16:43.751981+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T13:16:43.751981+0000","last_undegraded":"2023-09-28T13:16:43.751981+0000","last_fullsized":"2023-09-28T13:16:43.751981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:25:43.877047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":139,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.747458+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T13:16:43.747458+0000","last_peered":"2023-09-28T13:16:43.747458+0000","last_clean":"2023-09-28T13:16:43.747458+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T13:16:43.747458+0000","last_undegraded":"2023-09-28T13:16:43.747458+0000","last_fullsized":"2023-09-28T13:16:43.747458+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.754413+0000","last_change":"2023-09-28T13:16:43.749815+0000","last_active":"2023-09-28T13:16:43.754413+0000","last_peered":"2023-09-28T13:16:43.754413+0000","last_clean":"2023-09-28T13:16:43.754413+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T13:16:43.754413+0000","last_undegraded":"2023-09-28T13:16:43.754413+0000","last_fullsized":"2023-09-28T13:16:43.754413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.752300+0000","last_change":"2023-09-28T13:16:43.749669+0000","last_active":"2023-09-28T13:16:43.752300+0000","last_peered":"2023-09-28T13:16:43.752300+0000","last_clean":"2023-09-28T13:16:43.752300+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T13:16:43.752300+0000","last_undegraded":"2023-09-28T13:16:43.752300+0000","last_fullsized":"2023-09-28T13:16:43.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:32:03.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756755+0000","last_change":"2023-09-28T13:16:43.752514+0000","last_active":"2023-09-28T13:16:43.756755+0000","last_peered":"2023-09-28T13:16:43.756755+0000","last_clean":"2023-09-28T13:16:43.756755+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T13:16:43.756755+0000","last_undegraded":"2023-09-28T13:16:43.756755+0000","last_fullsized":"2023-09-28T13:16:43.756755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-28T13:16:43.756914+0000","last_change":"2023-09-28T13:16:43.752733+0000","last_active":"2023-09-28T13:16:43.756914+0000","last_peered":"2023-09-28T13:16:43.756914+0000","last_clean":"2023-09-28T13:16:43.756914+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T13:16:43.756914+0000","last_undegraded":"2023-09-28T13:16:43.756914+0000","last_fullsized":"2023-09-28T13:16:43.756914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7744,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364096,"statfs":{"total":96636764160,"available":96628834304,"internally_reserved":0,"allocated":122880,"data_stored":33548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":724992,"data_stored":627382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":724992,"data_stored":627382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T13:16:48.744 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T13:16:48.744 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-28T13:16:48.744 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-28T13:16:48.744 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-28T13:16:49.084 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T13:16:49.084 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-28T13:16:49.097 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-28T13:16:49.098 INFO:teuthology.run_tasks:Running task exec... 2023-09-28T13:16:49.107 INFO:teuthology.task.exec:Executing custom commands... 2023-09-28T13:16:49.107 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T13:16:49.108 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-09-28T13:16:49.757 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cache' created 2023-09-28T13:16:49.769 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-09-28T13:16:50.760 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-09-28T13:16:50.773 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-09-28T13:16:51.764 INFO:teuthology.orchestra.run.smithi069.stderr:set cache-mode for pool 'cache' to writeback 2023-09-28T13:16:51.778 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-09-28T13:16:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-09-28T13:16:52.779 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-09-28T13:16:53.773 INFO:teuthology.orchestra.run.smithi069.stderr:set pool 3 hit_set_type to bloom 2023-09-28T13:16:53.785 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-09-28T13:16:54.782 INFO:teuthology.orchestra.run.smithi069.stderr:set pool 3 hit_set_count to 8 2023-09-28T13:16:54.795 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-09-28T13:16:55.782 INFO:teuthology.orchestra.run.smithi069.stderr:set pool 3 hit_set_period to 60 2023-09-28T13:16:55.795 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-09-28T13:16:56.784 INFO:teuthology.orchestra.run.smithi069.stderr:set pool 3 target_max_objects to 250 2023-09-28T13:16:56.795 INFO:teuthology.run_tasks:Running task workunit... 2023-09-28T13:16:56.807 INFO:tasks.workunit:Pulling workunits from ref 2c186684db7f9ea0cdb098fc86b350a0fdd26eba 2023-09-28T13:16:56.807 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-09-28T13:16:56.807 DEBUG:teuthology.orchestra.run.smithi069:> stat -- /home/ubuntu/cephtest/mnt.0 2023-09-28T13:16:56.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T13:16:56.822 INFO:teuthology.orchestra.run.smithi069.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-09-28T13:16:56.823 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-09-28T13:16:56.877 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-09-28T13:16:56.877 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-09-28T13:16:56.930 INFO:tasks.workunit:timeout=3h 2023-09-28T13:16:56.931 INFO:tasks.workunit:cleanup=True 2023-09-28T13:16:56.931 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 2c186684db7f9ea0cdb098fc86b350a0fdd26eba 2023-09-28T13:16:56.985 INFO:tasks.workunit.client.0.smithi069.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-09-28T13:17:40.690 INFO:tasks.workunit.client.0.smithi069.stderr:Note: switching to '2c186684db7f9ea0cdb098fc86b350a0fdd26eba'. 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr:changes and commit them, and you can discard any commits you make in this 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr:state without impacting any branches by switching back to a branch. 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr:If you want to create a new branch to retain commits you create, you may 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr:do so (now or later) by using -c with the switch command. Example: 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr: git switch -c 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-09-28T13:17:40.691 INFO:tasks.workunit.client.0.smithi069.stderr:Or undo this operation with: 2023-09-28T13:17:40.692 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-09-28T13:17:40.692 INFO:tasks.workunit.client.0.smithi069.stderr: git switch - 2023-09-28T13:17:40.692 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-09-28T13:17:40.692 INFO:tasks.workunit.client.0.smithi069.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-09-28T13:17:40.692 INFO:tasks.workunit.client.0.smithi069.stderr: 2023-09-28T13:17:40.692 INFO:tasks.workunit.client.0.smithi069.stderr:HEAD is now at 2c186684db7 Merge branch 'wip-62711-quincy' of https://github.com/idryomov/ceph into wip-yuri3-testing-2023-09-27-0919-quincy 2023-09-28T13:17:40.695 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-09-28T13:17:40.760 INFO:tasks.workunit.client.0.smithi069.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-09-28T13:17:40.762 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-28T13:17:40.762 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-09-28T13:17:41.322 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-09-28T13:17:41.372 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-09-28T13:17:41.408 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-28T13:17:41.410 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-28T13:17:41.410 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-09-28T13:17:41.445 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-28T13:17:41.448 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-09-28T13:17:41.448 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-09-28T13:17:41.503 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2023-09-28T13:17:41.504 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2023-09-28T13:17:41.505 DEBUG:teuthology.orchestra.run.smithi069:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2c186684db7f9ea0cdb098fc86b350a0fdd26eba TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-09-28T13:17:41.561 INFO:tasks.workunit.client.0.smithi069.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ TIMEOUT=300 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ MAX_TIMEOUT=15 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ PG_NUM=4 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ TMPDIR=/tmp 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ type xmlstarlet 2023-09-28T13:17:41.563 INFO:tasks.workunit.client.0.smithi069.stderr:++ XMLSTARLET=xmlstarlet 2023-09-28T13:17:41.564 INFO:tasks.workunit.client.0.smithi069.stderr:+++ uname 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:++ '[' Linux = FreeBSD ']' 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:++ SED=sed 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:++ AWK=awk 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:+++ stty -a 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:+++ head -1 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-09-28T13:17:41.565 INFO:tasks.workunit.client.0.smithi069.stderr:++ termwidth= 2023-09-28T13:17:41.566 INFO:tasks.workunit.client.0.smithi069.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-09-28T13:17:41.566 INFO:tasks.workunit.client.0.smithi069.stderr:++ DIFFCOLOPTS='-y ' 2023-09-28T13:17:41.566 INFO:tasks.workunit.client.0.smithi069.stderr:++ KERNCORE=kernel.core_pattern 2023-09-28T13:17:41.566 INFO:tasks.workunit.client.0.smithi069.stderr:++ EXTRA_OPTS= 2023-09-28T13:17:41.570 INFO:tasks.workunit.client.0.smithi069.stderr:++ test '' = TESTS 2023-09-28T13:17:41.570 INFO:tasks.workunit.client.0.smithi069.stderr:+ export RBD_FORCE_ALLOW_V1=1 2023-09-28T13:17:41.570 INFO:tasks.workunit.client.0.smithi069.stderr:+ RBD_FORCE_ALLOW_V1=1 2023-09-28T13:17:41.571 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:41.571 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:17:41.571 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v '^0$' 2023-09-28T13:17:41.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2023-09-28T13:17:41.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ tiered=0 2023-09-28T13:17:41.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd dump 2023-09-28T13:17:41.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^pool' 2023-09-28T13:17:41.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ''\''rbd'\''' 2023-09-28T13:17:41.617 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep tier 2023-09-28T13:17:42.033 INFO:tasks.workunit.client.0.smithi069.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 lfor 19/19/19 flags hashpspool tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2023-09-28T13:17:42.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ tiered=1 2023-09-28T13:17:42.039 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_pool_image_args 2023-09-28T13:17:42.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing pool and image args...' 2023-09-28T13:17:42.040 INFO:tasks.workunit.client.0.smithi069.stdout:testing pool and image args... 2023-09-28T13:17:42.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:17:42.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.191 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.328 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.399 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.467 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.614 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.691 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.768 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.922 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:42.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:43.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:43.141 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:43.210 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:43.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:43.363 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-09-28T13:17:43.772 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'test' does not exist 2023-09-28T13:17:43.781 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool create test 32 2023-09-28T13:17:44.940 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'test' already exists 2023-09-28T13:17:44.950 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd pool init test 2023-09-28T13:17:47.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2023-09-28T13:17:47.840 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:47.840 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:17:47.840 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:17:47.874 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:17:47.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 1 test1 2023-09-28T13:17:47.903 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:47.902+0000 7f7db4b5e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:49.842 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:49.842 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test1 2023-09-28T13:17:49.873 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import --image test2 /tmp/empty 2023-09-28T13:17:49.902 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:49.901+0000 7f7cbbf70500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:49.911 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:49.912 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: --image is deprecated, use --dest 2023-09-28T13:17:49.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:49.915 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test2 2023-09-28T13:17:49.942 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --dest test3 import /tmp/empty 2023-09-28T13:17:49.970 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:49.969+0000 7f4f68d2b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:49.981 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:49.984 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:49.984 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test3 2023-09-28T13:17:50.010 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import /tmp/empty foo 2023-09-28T13:17:50.037 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:50.036+0000 7f153fd33500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:50.050 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:50.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:50.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q foo 2023-09-28T13:17:50.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2023-09-28T13:17:50.100 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-09-28T13:17:50.101 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:17:50.101 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import /tmp/empty test/empty@snap 2023-09-28T13:17:50.121 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-09-28T13:17:50.122 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:17:50.122 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import --image test/empty@snap /tmp/empty 2023-09-28T13:17:50.143 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-09-28T13:17:50.143 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: --image is deprecated, use --dest 2023-09-28T13:17:50.144 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:17:50.145 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import /tmp/empty@snap 2023-09-28T13:17:50.164 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-09-28T13:17:50.165 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:17:50.165 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:50.166 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:17:50.166 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:17:50.192 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:17:50.192 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import /tmp/empty test/test1 2023-09-28T13:17:50.218 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:50.217+0000 7f624f5b8500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:51.855 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:51.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:51.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test1 2023-09-28T13:17:51.890 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd -p test import /tmp/empty test2 2023-09-28T13:17:51.919 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:51.919+0000 7f570233b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:51.931 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:51.932 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-09-28T13:17:51.934 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:51.934 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test2 2023-09-28T13:17:51.962 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --image test3 -p test import /tmp/empty 2023-09-28T13:17:51.992 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:51.991+0000 7f329e8f5500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.004 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.004 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: --image is deprecated, use --dest 2023-09-28T13:17:52.004 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-09-28T13:17:52.006 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.006 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test3 2023-09-28T13:17:52.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --image test4 -p test import /tmp/empty 2023-09-28T13:17:52.063 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:52.062+0000 7ff916f6f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.071 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.072 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: --image is deprecated, use --dest 2023-09-28T13:17:52.072 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-09-28T13:17:52.074 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.074 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test4 2023-09-28T13:17:52.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --dest test5 -p test import /tmp/empty 2023-09-28T13:17:52.130 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:52.130+0000 7f44a880b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.141 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.141 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-09-28T13:17:52.143 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.144 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test5 2023-09-28T13:17:52.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2023-09-28T13:17:52.200 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:52.199+0000 7fa0e2b77500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.211 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.214 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.214 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test6 2023-09-28T13:17:52.241 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2023-09-28T13:17:52.270 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:52.269+0000 7f960886a500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.280 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.281 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: --image is deprecated, use --dest 2023-09-28T13:17:52.283 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.283 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test7 2023-09-28T13:17:52.310 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --image test/test8 import /tmp/empty 2023-09-28T13:17:52.337 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:52.336+0000 7f7e29dd4500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.349 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.349 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: --image is deprecated, use --dest 2023-09-28T13:17:52.352 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.352 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test8 2023-09-28T13:17:52.379 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --dest test/test9 import /tmp/empty 2023-09-28T13:17:52.406 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:52.405+0000 7fe63439c500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.420 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.422 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.422 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test9 2023-09-28T13:17:52.450 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import --pool test /tmp/empty 2023-09-28T13:17:52.477 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:52.476+0000 7fd072c76500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:52.487 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:17:52.488 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-09-28T13:17:52.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:52.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q empty 2023-09-28T13:17:52.517 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy test/test9 test10 2023-09-28T13:17:53.894 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:17:53.897 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:53.898 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -qv test10 2023-09-28T13:17:53.926 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:53.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test10 2023-09-28T13:17:53.953 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy test/test9 test/test10 2023-09-28T13:17:54.000 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:17:54.003 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:54.003 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test10 2023-09-28T13:17:54.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2023-09-28T13:17:54.083 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:17:54.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:54.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -q test11 2023-09-28T13:17:54.113 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2023-09-28T13:17:54.169 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:17:54.172 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:17:54.172 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test12 2023-09-28T13:17:54.198 INFO:tasks.workunit.client.0.smithi069.stdout:test12 2023-09-28T13:17:54.199 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls test 2023-09-28T13:17:54.199 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -qv test12 2023-09-28T13:17:54.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2023-09-28T13:17:54.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-09-28T13:17:54.973 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'test' does not exist 2023-09-28T13:17:54.980 INFO:tasks.workunit.client.0.smithi069.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-09-28T13:17:54.980 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm foo 2023-09-28T13:17:55.026 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:17:55.029 INFO:tasks.workunit.client.0.smithi069.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-09-28T13:17:55.029 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:17:55.065 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:17:55.067 INFO:tasks.workunit.client.0.smithi069.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-09-28T13:17:55.067 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test10 2023-09-28T13:17:55.142 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:17:55.144 INFO:tasks.workunit.client.0.smithi069.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-09-28T13:17:55.144 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test12 2023-09-28T13:17:55.222 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:17:55.225 INFO:tasks.workunit.client.0.smithi069.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-09-28T13:17:55.225 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:17:55.259 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:17:55.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-09-28T13:17:55.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test3 2023-09-28T13:17:55.299 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:17:55.301 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_rename 2023-09-28T13:17:55.302 INFO:tasks.workunit.client.0.smithi069.stdout:testing rename... 2023-09-28T13:17:55.302 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing rename...' 2023-09-28T13:17:55.302 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:17:55.302 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.370 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.439 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.513 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.590 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.666 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.739 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.814 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.888 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:55.958 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.027 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.101 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.251 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.323 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.399 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.475 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.551 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:17:56.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 1 -s 1 foo 2023-09-28T13:17:56.648 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:17:56.654 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:17:56.654+0000 7fca4130f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:17:56.660 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 bar 2023-09-28T13:17:56.705 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename foo foo2 2023-09-28T13:17:56.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename foo2 bar 2023-09-28T13:17:56.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep exists 2023-09-28T13:17:56.785 INFO:tasks.workunit.client.0.smithi069.stdout:2023-09-28T13:17:56.780+0000 7fe2b1f09500 -1 librbd::Operations: rbd image bar already exists 2023-09-28T13:17:56.785 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: rename error: (17) File exists 2023-09-28T13:17:56.785 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename bar bar2 2023-09-28T13:17:56.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename bar2 foo2 2023-09-28T13:17:56.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep exists 2023-09-28T13:17:56.868 INFO:tasks.workunit.client.0.smithi069.stdout:2023-09-28T13:17:56.863+0000 7f4f28748500 -1 librbd::Operations: rbd image foo2 already exists 2023-09-28T13:17:56.868 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: rename error: (17) File exists 2023-09-28T13:17:56.868 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool create rbd2 8 2023-09-28T13:17:57.971 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'rbd2' already exists 2023-09-28T13:17:57.980 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd pool init rbd2 2023-09-28T13:18:00.871 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -p rbd2 -s 1 foo 2023-09-28T13:18:00.902 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:00.902+0000 7ff414c16500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:02.739 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename rbd2/foo rbd2/bar 2023-09-28T13:18:02.786 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd -p rbd2 ls 2023-09-28T13:18:02.786 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep bar 2023-09-28T13:18:02.815 INFO:tasks.workunit.client.0.smithi069.stdout:bar 2023-09-28T13:18:02.815 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename rbd2/bar foo 2023-09-28T13:18:02.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename --pool rbd2 foo bar 2023-09-28T13:18:03.103 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2023-09-28T13:18:03.125 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: mv/rename across pools not supported 2023-09-28T13:18:03.125 INFO:tasks.workunit.client.0.smithi069.stderr:source pool: rbd2 dest pool: rbd 2023-09-28T13:18:03.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2023-09-28T13:18:03.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd -p rbd2 ls 2023-09-28T13:18:03.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep foo 2023-09-28T13:18:03.393 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:03.393+0000 7ff0e685b700 0 --2- 172.21.15.69:0/4121805268 >> v2:172.21.15.69:3300/0 conn(0x559b5a90d410 0x559b5a90f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:18:03.400 INFO:tasks.workunit.client.0.smithi069.stdout:foo 2023-09-28T13:18:03.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-09-28T13:18:03.983 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'rbd2' does not exist 2023-09-28T13:18:03.992 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:18:03.992 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.075 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.149 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.224 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.293 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.361 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.430 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.499 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.636 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.705 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.779 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.855 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:04.978 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.047 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.115 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.183 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.252 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.321 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_ls 2023-09-28T13:18:05.321 INFO:tasks.workunit.client.0.smithi069.stdout:testing ls... 2023-09-28T13:18:05.322 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing ls...' 2023-09-28T13:18:05.322 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:18:05.322 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.395 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.467 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.539 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.611 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.683 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.759 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.902 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:05.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.041 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.109 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.178 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.247 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.316 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.384 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.456 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.532 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:06.607 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 1 -s 1 test1 2023-09-28T13:18:06.630 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:06.635 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:06.636+0000 7fe93e54b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:06.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 1 -s 1 test2 2023-09-28T13:18:06.664 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:06.670 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:06.670+0000 7f5c1ff9c500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:06.675 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:06.675 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:18:06.702 INFO:tasks.workunit.client.0.smithi069.stdout:test1 2023-09-28T13:18:06.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:06.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test2 2023-09-28T13:18:06.731 INFO:tasks.workunit.client.0.smithi069.stdout:test2 2023-09-28T13:18:06.732 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:06.732 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:06.732 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:18:06.758 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:18:06.759 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:06.759 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test1.*1 MiB.*1' 2023-09-28T13:18:06.792 INFO:tasks.workunit.client.0.smithi069.stdout:test1 1 MiB 1 2023-09-28T13:18:06.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:06.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test2.*1 MiB.*1' 2023-09-28T13:18:06.825 INFO:tasks.workunit.client.0.smithi069.stdout:test2 1 MiB 1 2023-09-28T13:18:06.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:18:06.860 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:06.863 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:06.901 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:06.903 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test1 2023-09-28T13:18:06.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test2 2023-09-28T13:18:06.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:06.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:18:07.013 INFO:tasks.workunit.client.0.smithi069.stdout:test1 2023-09-28T13:18:07.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:07.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test2 2023-09-28T13:18:07.040 INFO:tasks.workunit.client.0.smithi069.stdout:test2 2023-09-28T13:18:07.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:07.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:07.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:18:07.066 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:18:07.067 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:07.067 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test1.*1 MiB.*2' 2023-09-28T13:18:07.102 INFO:tasks.workunit.client.0.smithi069.stdout:test1 1 MiB 2 2023-09-28T13:18:07.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:07.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test2.*1 MiB.*2' 2023-09-28T13:18:07.137 INFO:tasks.workunit.client.0.smithi069.stdout:test2 1 MiB 2 2023-09-28T13:18:07.137 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:18:07.223 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:07.223+0000 7f00d226e700 0 -- 172.21.15.69:0/1742377821 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f00b8008740 msgr2=0x7f00b800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:07.223 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:07.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:07.330 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:07.330+0000 7fcefd8de700 0 -- 172.21.15.69:0/850373031 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fcedc008740 msgr2=0x7fcedc00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:07.331 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:07.333 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test1 2023-09-28T13:18:07.377 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 1 -s 1 test2 2023-09-28T13:18:07.400 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:07.405 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:07.406+0000 7f3b8f9c0500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:07.412 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:07.412 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:18:07.438 INFO:tasks.workunit.client.0.smithi069.stdout:test1 2023-09-28T13:18:07.439 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:07.439 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test2 2023-09-28T13:18:07.465 INFO:tasks.workunit.client.0.smithi069.stdout:test2 2023-09-28T13:18:07.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:07.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:07.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:18:07.492 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:18:07.492 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:07.493 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test1.*1 MiB.*2' 2023-09-28T13:18:07.528 INFO:tasks.workunit.client.0.smithi069.stdout:test1 1 MiB 2 2023-09-28T13:18:07.528 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:07.528 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test2.*1 MiB.*1' 2023-09-28T13:18:07.563 INFO:tasks.workunit.client.0.smithi069.stdout:test2 1 MiB 1 2023-09-28T13:18:07.564 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:18:07.564 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:07.636 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:07.705 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:07.774 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:07.848 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:07.923 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:07.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.147 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.220 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.289 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.357 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.426 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.495 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.628 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.707 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.783 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.859 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:08.935 INFO:tasks.workunit.client.0.smithi069.stderr:++ seq -w 00 99 2023-09-28T13:18:08.947 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:08.947 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.00 -s 1 2023-09-28T13:18:08.975 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:08.975+0000 7f01c75b2500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:08.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:08.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.01 -s 1 2023-09-28T13:18:09.011 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.012+0000 7f5b359bf500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.02 -s 1 2023-09-28T13:18:09.047 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.048+0000 7f08b6eb8500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.053 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.053 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.03 -s 1 2023-09-28T13:18:09.081 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.081+0000 7f316599e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.04 -s 1 2023-09-28T13:18:09.312 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.312+0000 7f56c9fdf700 0 --2- 172.21.15.69:0/791574801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc9c366be0 0x55cc9c4063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:18:09.315 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.315+0000 7f56d24cd500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.321 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.321 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.05 -s 1 2023-09-28T13:18:09.349 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.349+0000 7f8e1eef1500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.354 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.354 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.06 -s 1 2023-09-28T13:18:09.382 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.382+0000 7f52ded9f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.387 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.387 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.07 -s 1 2023-09-28T13:18:09.415 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.415+0000 7f9b745d3500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.421 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.421 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.08 -s 1 2023-09-28T13:18:09.449 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.449+0000 7feb5cd83500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.454 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.454 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.09 -s 1 2023-09-28T13:18:09.482 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.482+0000 7f492175c500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.487 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.488 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.10 -s 1 2023-09-28T13:18:09.515 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.516+0000 7f5262cc1500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.11 -s 1 2023-09-28T13:18:09.549 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.549+0000 7fbda1bb9500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.556 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.556 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.12 -s 1 2023-09-28T13:18:09.584 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.584+0000 7f251788a500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.594 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.595 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.13 -s 1 2023-09-28T13:18:09.622 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.622+0000 7fd26a965500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.633 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.633 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.14 -s 1 2023-09-28T13:18:09.661 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.661+0000 7fea99b8e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.672 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.672 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.15 -s 1 2023-09-28T13:18:09.701 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.700+0000 7f6982c40500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.706 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.706 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.16 -s 1 2023-09-28T13:18:09.733 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.733+0000 7f6363363500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.740 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.740 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.17 -s 1 2023-09-28T13:18:09.768 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.768+0000 7fc69b69f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.776 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.776 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.18 -s 1 2023-09-28T13:18:09.804 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.804+0000 7f0709547500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.813 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.813 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.19 -s 1 2023-09-28T13:18:09.841 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.841+0000 7fc76ed86500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.20 -s 1 2023-09-28T13:18:09.879 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.879+0000 7f14beff6500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.888 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.888 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.21 -s 1 2023-09-28T13:18:09.916 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.916+0000 7f7eb1f64500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.922 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.923 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.22 -s 1 2023-09-28T13:18:09.950 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.950+0000 7fa8abddd500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.956 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.956 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.23 -s 1 2023-09-28T13:18:09.984 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:09.984+0000 7fbebf1ee500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:09.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:09.991 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.24 -s 1 2023-09-28T13:18:10.018 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.019+0000 7f4e0531d500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.025 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.025 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.25 -s 1 2023-09-28T13:18:10.053 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.053+0000 7f2e82af7500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.26 -s 1 2023-09-28T13:18:10.085 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.086+0000 7fda2f832500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.091 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.091 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.27 -s 1 2023-09-28T13:18:10.119 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.119+0000 7f6631878500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.124 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.124 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.28 -s 1 2023-09-28T13:18:10.152 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.152+0000 7f4d8094f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.29 -s 1 2023-09-28T13:18:10.185 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.185+0000 7f327a11c500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.190 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.190 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.30 -s 1 2023-09-28T13:18:10.218 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.218+0000 7f0777900500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.224 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.224 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.31 -s 1 2023-09-28T13:18:10.251 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.252+0000 7f1092767500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.257 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.257 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.32 -s 1 2023-09-28T13:18:10.285 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.285+0000 7fe016f81500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.290 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.291 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.33 -s 1 2023-09-28T13:18:10.318 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.319+0000 7f34cba5f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.331 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.331 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.34 -s 1 2023-09-28T13:18:10.359 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.359+0000 7f01ba048500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.365 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.365 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.35 -s 1 2023-09-28T13:18:10.392 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.393+0000 7fc06881a500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.399 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.399 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.36 -s 1 2023-09-28T13:18:10.426 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.426+0000 7f93cb85b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.431 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.431 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.37 -s 1 2023-09-28T13:18:10.460 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.460+0000 7fc79a977500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.38 -s 1 2023-09-28T13:18:10.494 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.494+0000 7f38b551f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.500 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.500 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.39 -s 1 2023-09-28T13:18:10.528 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.528+0000 7f1d54d0f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.535 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.535 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.40 -s 1 2023-09-28T13:18:10.563 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.563+0000 7f5cfd860500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.574 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.574 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.41 -s 1 2023-09-28T13:18:10.602 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.602+0000 7f6e47b07500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.611 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.611 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.42 -s 1 2023-09-28T13:18:10.639 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.639+0000 7fa1bb712500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.648 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.648 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.43 -s 1 2023-09-28T13:18:10.675 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.676+0000 7f10e111e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.682 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.682 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.44 -s 1 2023-09-28T13:18:10.710 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.710+0000 7f1bd4982500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.721 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.721 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.45 -s 1 2023-09-28T13:18:10.748 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.748+0000 7fb4291f0500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.46 -s 1 2023-09-28T13:18:10.785 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.786+0000 7fa34a5a8500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.47 -s 1 2023-09-28T13:18:10.821 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.821+0000 7fbd96913500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.827 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.828 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.48 -s 1 2023-09-28T13:18:10.855 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.856+0000 7faf20511500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.49 -s 1 2023-09-28T13:18:10.893 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.893+0000 7f6866fb7500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.900 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.50 -s 1 2023-09-28T13:18:10.927 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.927+0000 7f8065a3d500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.935 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.935 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.51 -s 1 2023-09-28T13:18:10.963 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.963+0000 7f956eff9500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:10.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:10.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.52 -s 1 2023-09-28T13:18:10.999 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:10.999+0000 7fa7bcc4f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.006 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.006 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.53 -s 1 2023-09-28T13:18:11.034 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.034+0000 7f5994b55500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.039 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.040 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.54 -s 1 2023-09-28T13:18:11.067 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.068+0000 7f8a19eb7500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.081 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.081 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.55 -s 1 2023-09-28T13:18:11.101 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.101+0000 7f0daec5f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.106 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.106 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.56 -s 1 2023-09-28T13:18:11.134 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.134+0000 7f0dac059500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.140 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.140 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.57 -s 1 2023-09-28T13:18:11.168 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.168+0000 7f5a6daaa500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.58 -s 1 2023-09-28T13:18:11.204 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.204+0000 7fb2fad98500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.209 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.209 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.59 -s 1 2023-09-28T13:18:11.236 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.237+0000 7fe14cec9500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.242 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.242 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.60 -s 1 2023-09-28T13:18:11.270 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.271+0000 7f70eaaa1500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.278 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.278 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.61 -s 1 2023-09-28T13:18:11.306 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.306+0000 7f92ec0ff500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.317 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.317 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.62 -s 1 2023-09-28T13:18:11.345 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.345+0000 7f9cf387a500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.352 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.352 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.63 -s 1 2023-09-28T13:18:11.379 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.380+0000 7f8cb7b4b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.390 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.390 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.64 -s 1 2023-09-28T13:18:11.418 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.418+0000 7fcce7aac500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.428 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.428 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.65 -s 1 2023-09-28T13:18:11.456 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.456+0000 7fb958303500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.462 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.462 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.66 -s 1 2023-09-28T13:18:11.489 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.490+0000 7fcb00872500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.67 -s 1 2023-09-28T13:18:11.523 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.524+0000 7f7d12082500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.533 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.533 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.68 -s 1 2023-09-28T13:18:11.561 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.562+0000 7f0695b88500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.576 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.576 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.69 -s 1 2023-09-28T13:18:11.604 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.604+0000 7fbf8733e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.614 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.614 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.70 -s 1 2023-09-28T13:18:11.643 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.644+0000 7f24e2add500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.660 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.660 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.71 -s 1 2023-09-28T13:18:11.688 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.688+0000 7f5ce2489500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.696 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.696 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.72 -s 1 2023-09-28T13:18:11.723 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.724+0000 7f7484801500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.730 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.730 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.73 -s 1 2023-09-28T13:18:11.757 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.758+0000 7f7c22457500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.765 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.765 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.74 -s 1 2023-09-28T13:18:11.792 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.793+0000 7f2d4c44d500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.798 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.798 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.75 -s 1 2023-09-28T13:18:11.826 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.826+0000 7f35b3f6a500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.833 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.76 -s 1 2023-09-28T13:18:11.860 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.860+0000 7f088f105500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.866 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.866 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.77 -s 1 2023-09-28T13:18:11.893 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.894+0000 7f704ad58500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.901 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.901 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.78 -s 1 2023-09-28T13:18:11.929 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.929+0000 7ff539b36500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.935 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.935 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.79 -s 1 2023-09-28T13:18:11.962 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:11.963+0000 7fc61c8d1500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:11.973 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:11.973 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.80 -s 1 2023-09-28T13:18:12.001 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.001+0000 7f76208a5500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.011 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.011 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.81 -s 1 2023-09-28T13:18:12.039 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.039+0000 7f5311262500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.050 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.050 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.82 -s 1 2023-09-28T13:18:12.078 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.079+0000 7f1a24210500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.83 -s 1 2023-09-28T13:18:12.118 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.118+0000 7f7699dde500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.128 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.129 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.84 -s 1 2023-09-28T13:18:12.156 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.156+0000 7fef1487e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.164 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.164 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.85 -s 1 2023-09-28T13:18:12.192 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.192+0000 7eff6b18c500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.201 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.201 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.86 -s 1 2023-09-28T13:18:12.228 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.229+0000 7fea40434500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.235 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.235 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.87 -s 1 2023-09-28T13:18:12.263 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.263+0000 7f37bf98b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.274 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.274 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.88 -s 1 2023-09-28T13:18:12.302 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.302+0000 7fd632f8b500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.310 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.310 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.89 -s 1 2023-09-28T13:18:12.338 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.338+0000 7efffbcb6500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.350 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.350 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.90 -s 1 2023-09-28T13:18:12.377 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.377+0000 7febec9f4500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.383 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.383 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.91 -s 1 2023-09-28T13:18:12.411 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.411+0000 7f63b5e1c500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.417 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.417 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.92 -s 1 2023-09-28T13:18:12.444 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.444+0000 7fa6c82c8500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.451 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.451 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.93 -s 1 2023-09-28T13:18:12.479 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.479+0000 7f44e5141500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.485 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.485 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.94 -s 1 2023-09-28T13:18:12.714 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.714+0000 7f2a79c15500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.720 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.720 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.95 -s 1 2023-09-28T13:18:12.748 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.749+0000 7f90b8cb5500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.754 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.754 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.96 -s 1 2023-09-28T13:18:12.781 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.782+0000 7fbcf931d500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.788 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.788 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.97 -s 1 2023-09-28T13:18:12.815 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.816+0000 7f7fc9db0500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.821 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.821 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.98 -s 1 2023-09-28T13:18:12.849 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.849+0000 7f8c584de500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:12.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.99 -s 1 2023-09-28T13:18:12.885 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.885+0000 7f2573734500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:12.893 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:12.894 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:12.894 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 100 2023-09-28T13:18:12.920 INFO:tasks.workunit.client.0.smithi069.stdout:100 2023-09-28T13:18:12.921 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:12.921 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep image 2023-09-28T13:18:12.921 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:12.921 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 100 2023-09-28T13:18:12.990 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:12.990+0000 7f5144c33700 0 -- 172.21.15.69:0/999515814 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55df6bc334b0 msgr2=0x55df6bc30750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:13.199 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:13.199+0000 7f5144432700 0 -- 172.21.15.69:0/999515814 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55df6bcdd680 msgr2=0x55df6bcdda50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:13.377 INFO:tasks.workunit.client.0.smithi069.stdout:100 2023-09-28T13:18:13.377 INFO:tasks.workunit.client.0.smithi069.stderr:++ seq -w 00 99 2023-09-28T13:18:13.378 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.378 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.00 2023-09-28T13:18:13.420 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.01 2023-09-28T13:18:13.458 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.460 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.460 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.02 2023-09-28T13:18:13.497 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.499 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.500 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.03 2023-09-28T13:18:13.535 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.537 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.04 2023-09-28T13:18:13.573 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.575 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.575 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.05 2023-09-28T13:18:13.610 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.06 2023-09-28T13:18:13.649 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.651 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.652 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.07 2023-09-28T13:18:13.687 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.690 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.690 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.08 2023-09-28T13:18:13.726 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.728 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.728 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.09 2023-09-28T13:18:13.764 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.767 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.767 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.10 2023-09-28T13:18:13.806 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.808 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.808 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.11 2023-09-28T13:18:13.850 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.853 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.853 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.12 2023-09-28T13:18:13.893 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.896 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.896 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.13 2023-09-28T13:18:13.936 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.14 2023-09-28T13:18:13.975 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:13.978 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:13.978 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.15 2023-09-28T13:18:14.013 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.016 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.016 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.16 2023-09-28T13:18:14.051 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.054 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.054 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.17 2023-09-28T13:18:14.089 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.18 2023-09-28T13:18:14.127 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.19 2023-09-28T13:18:14.170 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.173 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.173 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.20 2023-09-28T13:18:14.209 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.21 2023-09-28T13:18:14.247 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.249 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.249 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.22 2023-09-28T13:18:14.287 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.290 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.290 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.23 2023-09-28T13:18:14.330 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.333 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.333 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.24 2023-09-28T13:18:14.368 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.371 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.371 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.25 2023-09-28T13:18:14.411 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.414 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.414 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.26 2023-09-28T13:18:14.450 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.452 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.452 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.27 2023-09-28T13:18:14.494 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.28 2023-09-28T13:18:14.559 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.562 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.562 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.29 2023-09-28T13:18:14.607 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.609 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.609 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.30 2023-09-28T13:18:14.833 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:14.832+0000 7f472a658700 0 --2- 172.21.15.69:0/877600643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5565a12a12c0 0x5565a132e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:18:14.848 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:14.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:14.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.31 2023-09-28T13:18:15.090 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.093 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.093 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.32 2023-09-28T13:18:15.132 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.135 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.135 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.33 2023-09-28T13:18:15.171 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.174 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.174 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.34 2023-09-28T13:18:15.223 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.35 2023-09-28T13:18:15.264 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.266 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.267 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.36 2023-09-28T13:18:15.304 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.37 2023-09-28T13:18:15.344 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.347 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.347 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.38 2023-09-28T13:18:15.386 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.388 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.388 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.39 2023-09-28T13:18:15.429 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.431 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.431 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.40 2023-09-28T13:18:15.474 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.476 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.476 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.41 2023-09-28T13:18:15.513 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.515 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.515 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.42 2023-09-28T13:18:15.552 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.555 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.555 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.43 2023-09-28T13:18:15.593 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.595 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.595 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.44 2023-09-28T13:18:15.634 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.636 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.636 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.45 2023-09-28T13:18:15.674 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.677 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.677 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.46 2023-09-28T13:18:15.713 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.47 2023-09-28T13:18:15.752 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.755 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.755 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.48 2023-09-28T13:18:15.795 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.797 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.798 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.49 2023-09-28T13:18:15.837 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:15.839 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:15.839 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.50 2023-09-28T13:18:16.082 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.084 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.084 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.51 2023-09-28T13:18:16.128 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.52 2023-09-28T13:18:16.172 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.175 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.53 2023-09-28T13:18:16.218 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.220 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.221 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.54 2023-09-28T13:18:16.257 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.55 2023-09-28T13:18:16.296 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.298 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.298 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.56 2023-09-28T13:18:16.335 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.337 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.338 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.57 2023-09-28T13:18:16.374 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.377 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.58 2023-09-28T13:18:16.415 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.417 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.417 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.59 2023-09-28T13:18:16.455 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.458 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.458 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.60 2023-09-28T13:18:16.498 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.501 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.501 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.61 2023-09-28T13:18:16.539 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.542 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.542 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.62 2023-09-28T13:18:16.580 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.583 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.583 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.63 2023-09-28T13:18:16.621 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.624 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.624 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.64 2023-09-28T13:18:16.662 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.664 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.664 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.65 2023-09-28T13:18:16.704 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.707 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.707 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.66 2023-09-28T13:18:16.747 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.749 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.749 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.67 2023-09-28T13:18:16.794 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.797 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.797 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.68 2023-09-28T13:18:16.842 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.845 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.69 2023-09-28T13:18:16.887 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.890 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.890 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.70 2023-09-28T13:18:16.940 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.943 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.71 2023-09-28T13:18:16.980 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:16.982 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:16.982 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.72 2023-09-28T13:18:17.018 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.73 2023-09-28T13:18:17.063 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.74 2023-09-28T13:18:17.108 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.110 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.110 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.75 2023-09-28T13:18:17.155 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.76 2023-09-28T13:18:17.196 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.199 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.199 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.77 2023-09-28T13:18:17.238 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.241 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.241 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.78 2023-09-28T13:18:17.283 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.285 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.285 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.79 2023-09-28T13:18:17.323 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.326 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.326 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.80 2023-09-28T13:18:17.361 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.364 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.364 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.81 2023-09-28T13:18:17.399 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.402 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.402 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.82 2023-09-28T13:18:17.439 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.441 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.442 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.83 2023-09-28T13:18:17.478 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.481 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.481 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.84 2023-09-28T13:18:17.517 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.520 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.520 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.85 2023-09-28T13:18:17.561 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.564 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.564 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.86 2023-09-28T13:18:17.603 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.605 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.605 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.87 2023-09-28T13:18:17.645 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.647 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.647 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.88 2023-09-28T13:18:17.684 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.687 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.687 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.89 2023-09-28T13:18:17.728 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.730 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.731 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.90 2023-09-28T13:18:17.772 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.91 2023-09-28T13:18:17.826 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.829 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.829 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.92 2023-09-28T13:18:17.871 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.93 2023-09-28T13:18:17.912 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.915 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.915 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.94 2023-09-28T13:18:17.966 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:17.968 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:17.969 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.95 2023-09-28T13:18:18.007 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:18.010 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.010 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.96 2023-09-28T13:18:18.047 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:18.049 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.049 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.97 2023-09-28T13:18:18.085 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:18.087 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.088 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.98 2023-09-28T13:18:18.128 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:18.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.99 2023-09-28T13:18:18.167 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:18.170 INFO:tasks.workunit.client.0.smithi069.stderr:++ seq -w 00 99 2023-09-28T13:18:18.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.171 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.00 --image-format 2 -s 1 2023-09-28T13:18:18.213 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.213 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.01 --image-format 2 -s 1 2023-09-28T13:18:18.253 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.253 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.02 --image-format 2 -s 1 2023-09-28T13:18:18.295 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.296 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.03 --image-format 2 -s 1 2023-09-28T13:18:18.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.340 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.04 --image-format 2 -s 1 2023-09-28T13:18:18.386 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.386 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.05 --image-format 2 -s 1 2023-09-28T13:18:18.428 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.428 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.06 --image-format 2 -s 1 2023-09-28T13:18:18.478 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.478 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.07 --image-format 2 -s 1 2023-09-28T13:18:18.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.521 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.08 --image-format 2 -s 1 2023-09-28T13:18:18.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.09 --image-format 2 -s 1 2023-09-28T13:18:18.611 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.612 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.10 --image-format 2 -s 1 2023-09-28T13:18:18.656 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.656 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.11 --image-format 2 -s 1 2023-09-28T13:18:18.700 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.700 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.12 --image-format 2 -s 1 2023-09-28T13:18:18.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.13 --image-format 2 -s 1 2023-09-28T13:18:18.793 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.794 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.14 --image-format 2 -s 1 2023-09-28T13:18:18.836 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.836 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.15 --image-format 2 -s 1 2023-09-28T13:18:18.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.16 --image-format 2 -s 1 2023-09-28T13:18:18.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.17 --image-format 2 -s 1 2023-09-28T13:18:18.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:18.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.18 --image-format 2 -s 1 2023-09-28T13:18:19.028 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.028 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.19 --image-format 2 -s 1 2023-09-28T13:18:19.070 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.20 --image-format 2 -s 1 2023-09-28T13:18:19.112 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.112 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.21 --image-format 2 -s 1 2023-09-28T13:18:19.165 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.166 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.22 --image-format 2 -s 1 2023-09-28T13:18:19.209 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.209 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.23 --image-format 2 -s 1 2023-09-28T13:18:19.252 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.252 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.24 --image-format 2 -s 1 2023-09-28T13:18:19.302 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.302 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.25 --image-format 2 -s 1 2023-09-28T13:18:19.346 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.347 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.26 --image-format 2 -s 1 2023-09-28T13:18:19.387 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.387 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.27 --image-format 2 -s 1 2023-09-28T13:18:19.435 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.435 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.28 --image-format 2 -s 1 2023-09-28T13:18:19.480 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.481 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.29 --image-format 2 -s 1 2023-09-28T13:18:19.522 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.522 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.30 --image-format 2 -s 1 2023-09-28T13:18:19.565 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.565 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.31 --image-format 2 -s 1 2023-09-28T13:18:19.610 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.610 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.32 --image-format 2 -s 1 2023-09-28T13:18:19.658 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.658 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.33 --image-format 2 -s 1 2023-09-28T13:18:19.709 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.709 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.34 --image-format 2 -s 1 2023-09-28T13:18:19.752 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.752 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.35 --image-format 2 -s 1 2023-09-28T13:18:19.796 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.796 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.36 --image-format 2 -s 1 2023-09-28T13:18:19.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.37 --image-format 2 -s 1 2023-09-28T13:18:19.897 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.897 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.38 --image-format 2 -s 1 2023-09-28T13:18:19.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.39 --image-format 2 -s 1 2023-09-28T13:18:19.993 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:19.993 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.40 --image-format 2 -s 1 2023-09-28T13:18:20.038 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.038 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.41 --image-format 2 -s 1 2023-09-28T13:18:20.083 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.083 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.42 --image-format 2 -s 1 2023-09-28T13:18:20.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.43 --image-format 2 -s 1 2023-09-28T13:18:20.173 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.173 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.44 --image-format 2 -s 1 2023-09-28T13:18:20.217 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.217 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.45 --image-format 2 -s 1 2023-09-28T13:18:20.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.46 --image-format 2 -s 1 2023-09-28T13:18:20.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.47 --image-format 2 -s 1 2023-09-28T13:18:20.362 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.362 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.48 --image-format 2 -s 1 2023-09-28T13:18:20.406 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.406 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.49 --image-format 2 -s 1 2023-09-28T13:18:20.453 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.453 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.50 --image-format 2 -s 1 2023-09-28T13:18:20.495 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.495 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.51 --image-format 2 -s 1 2023-09-28T13:18:20.541 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.541 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.52 --image-format 2 -s 1 2023-09-28T13:18:20.580 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.580 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.53 --image-format 2 -s 1 2023-09-28T13:18:20.625 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.625 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.54 --image-format 2 -s 1 2023-09-28T13:18:20.669 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.670 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.55 --image-format 2 -s 1 2023-09-28T13:18:20.714 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.714 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.56 --image-format 2 -s 1 2023-09-28T13:18:20.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.57 --image-format 2 -s 1 2023-09-28T13:18:20.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.799 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.58 --image-format 2 -s 1 2023-09-28T13:18:20.841 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.841 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.59 --image-format 2 -s 1 2023-09-28T13:18:20.886 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.886 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.60 --image-format 2 -s 1 2023-09-28T13:18:20.932 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.932 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.61 --image-format 2 -s 1 2023-09-28T13:18:20.974 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:20.974 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.62 --image-format 2 -s 1 2023-09-28T13:18:21.016 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.016 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.63 --image-format 2 -s 1 2023-09-28T13:18:21.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.058 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.64 --image-format 2 -s 1 2023-09-28T13:18:21.107 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.107 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.65 --image-format 2 -s 1 2023-09-28T13:18:21.153 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.153 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.66 --image-format 2 -s 1 2023-09-28T13:18:21.194 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.195 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.67 --image-format 2 -s 1 2023-09-28T13:18:21.237 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.237 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.68 --image-format 2 -s 1 2023-09-28T13:18:21.285 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.69 --image-format 2 -s 1 2023-09-28T13:18:21.329 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.329 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.70 --image-format 2 -s 1 2023-09-28T13:18:21.378 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.378 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.71 --image-format 2 -s 1 2023-09-28T13:18:21.428 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.428 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.72 --image-format 2 -s 1 2023-09-28T13:18:21.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.73 --image-format 2 -s 1 2023-09-28T13:18:21.512 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.512 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.74 --image-format 2 -s 1 2023-09-28T13:18:21.554 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.555 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.75 --image-format 2 -s 1 2023-09-28T13:18:21.596 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.76 --image-format 2 -s 1 2023-09-28T13:18:21.638 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.638 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.77 --image-format 2 -s 1 2023-09-28T13:18:21.680 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.680 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.78 --image-format 2 -s 1 2023-09-28T13:18:21.727 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.727 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.79 --image-format 2 -s 1 2023-09-28T13:18:21.770 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.770 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.80 --image-format 2 -s 1 2023-09-28T13:18:21.810 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.810 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.81 --image-format 2 -s 1 2023-09-28T13:18:21.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.82 --image-format 2 -s 1 2023-09-28T13:18:21.897 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.897 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.83 --image-format 2 -s 1 2023-09-28T13:18:21.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.941 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.84 --image-format 2 -s 1 2023-09-28T13:18:21.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:21.984 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.85 --image-format 2 -s 1 2023-09-28T13:18:22.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.86 --image-format 2 -s 1 2023-09-28T13:18:22.077 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.077 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.87 --image-format 2 -s 1 2023-09-28T13:18:22.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.88 --image-format 2 -s 1 2023-09-28T13:18:22.168 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.168 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.89 --image-format 2 -s 1 2023-09-28T13:18:22.210 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.90 --image-format 2 -s 1 2023-09-28T13:18:22.253 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.253 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.91 --image-format 2 -s 1 2023-09-28T13:18:22.294 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.295 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.92 --image-format 2 -s 1 2023-09-28T13:18:22.341 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.341 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.93 --image-format 2 -s 1 2023-09-28T13:18:22.382 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.382 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.94 --image-format 2 -s 1 2023-09-28T13:18:22.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.423 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.95 --image-format 2 -s 1 2023-09-28T13:18:22.465 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.465 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.96 --image-format 2 -s 1 2023-09-28T13:18:22.508 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.508 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.97 --image-format 2 -s 1 2023-09-28T13:18:22.552 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.552 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.98 --image-format 2 -s 1 2023-09-28T13:18:22.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:22.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create image.99 --image-format 2 -s 1 2023-09-28T13:18:22.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:22.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:22.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 100 2023-09-28T13:18:22.667 INFO:tasks.workunit.client.0.smithi069.stdout:100 2023-09-28T13:18:22.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:18:22.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep image 2023-09-28T13:18:22.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:22.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 100 2023-09-28T13:18:22.724 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:22.723+0000 7f46622a2700 0 -- 172.21.15.69:0/3714914465 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x559bcb1add70 msgr2=0x559bcb1ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:22.728 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:22.728+0000 7f46622a2700 0 -- 172.21.15.69:0/3714914465 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f464403a290 msgr2=0x7f464403c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.017 INFO:tasks.workunit.client.0.smithi069.stdout:100 2023-09-28T13:18:23.017 INFO:tasks.workunit.client.0.smithi069.stderr:++ seq -w 00 99 2023-09-28T13:18:23.018 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.018 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.00 2023-09-28T13:18:23.130 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.129+0000 7f264cb3f700 0 -- 172.21.15.69:0/1248939978 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f2628008740 msgr2=0x7f262800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.131 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.133 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.134 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.01 2023-09-28T13:18:23.245 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.244+0000 7f4fb04a0700 0 -- 172.21.15.69:0/1166575912 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f4f9403a310 msgr2=0x7f4f9403c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.261 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.264 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.264 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.02 2023-09-28T13:18:23.372 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.372+0000 7fbbad148700 0 -- 172.21.15.69:0/1192636168 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fbb88008740 msgr2=0x7fbb8800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.373 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.375 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.375 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.03 2023-09-28T13:18:23.488 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.487+0000 7f7ce1502700 0 -- 172.21.15.69:0/585339984 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f7cbc008740 msgr2=0x7f7cbc00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.488 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.491 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.491 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.04 2023-09-28T13:18:23.598 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.598+0000 7f51a8ac3700 0 -- 172.21.15.69:0/867830320 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f5184008740 msgr2=0x7f518400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.599 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.602 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.602 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.05 2023-09-28T13:18:23.696 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.695+0000 7f079ef19700 0 -- 172.21.15.69:0/4020758677 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f078003a360 msgr2=0x7f078003c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.699 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.06 2023-09-28T13:18:23.803 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.802+0000 7f8a34033700 0 -- 172.21.15.69:0/1430827889 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f8a14005fb0 msgr2=0x7f8a14008460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.803 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.806 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.806 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.07 2023-09-28T13:18:23.927 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:23.926+0000 7f169501d700 0 -- 172.21.15.69:0/3309373399 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55f46ebb3480 msgr2=0x55f46eb69160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:23.927 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:23.930 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:23.930 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.08 2023-09-28T13:18:24.021 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.020+0000 7f31a6d70700 0 -- 172.21.15.69:0/85387508 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f318c008740 msgr2=0x7f318c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.022 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.024 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.024 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.09 2023-09-28T13:18:24.126 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.124+0000 7f9d14221700 0 -- 172.21.15.69:0/697704364 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f9cf403a360 msgr2=0x7f9cf403c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.142 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.145 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.145 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.10 2023-09-28T13:18:24.261 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.260+0000 7fbbb0f9e700 0 -- 172.21.15.69:0/12964065 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fbb8c008740 msgr2=0x7fbb8c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:24.262 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.264 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.264 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.11 2023-09-28T13:18:24.350 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.349+0000 7f4533ea0700 0 -- 172.21.15.69:0/1223359116 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f4518008740 msgr2=0x7f451800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.350 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.353 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.353 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.12 2023-09-28T13:18:24.464 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.463+0000 7f60b0fb9700 0 -- 172.21.15.69:0/3499374412 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x557fb5b13640 msgr2=0x557fb5b12bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.464 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.467 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.13 2023-09-28T13:18:24.583 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.583+0000 7f13366b8700 0 -- 172.21.15.69:0/1160866825 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55819cc69070 msgr2=0x55819cd0aba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.585 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.14 2023-09-28T13:18:24.686 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.685+0000 7fe185bfa700 0 -- 172.21.15.69:0/1613269211 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fe16c006500 msgr2=0x7fe16c011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.686 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.689 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.689 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.15 2023-09-28T13:18:24.804 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.803+0000 7f7947a1e700 0 -- 172.21.15.69:0/1020732317 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f792c008740 msgr2=0x7f792c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.804 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.806 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.807 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.16 2023-09-28T13:18:24.909 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:24.908+0000 7fa20d0f4700 0 -- 172.21.15.69:0/3918844272 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fa1e8006500 msgr2=0x7fa1e8011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:24.910 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:24.912 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:24.912 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.17 2023-09-28T13:18:25.020 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.019+0000 7fc8c6d43700 0 -- 172.21.15.69:0/52919838 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fc8a8006720 msgr2=0x7fc8a8008ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.020 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.023 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.023 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.18 2023-09-28T13:18:25.137 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.136+0000 7f2526b64700 0 -- 172.21.15.69:0/658176976 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f2504008740 msgr2=0x7f250400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.137 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.140 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.140 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.19 2023-09-28T13:18:25.258 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.257+0000 7fbe369cf700 0 -- 172.21.15.69:0/390280129 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x557bd7a38c40 msgr2=0x557bd7a176f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.258 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.20 2023-09-28T13:18:25.365 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.365+0000 7f622f8d6700 0 -- 172.21.15.69:0/2437085975 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x564d4b3b5b10 msgr2=0x564d4b3da1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.366 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.21 2023-09-28T13:18:25.477 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.476+0000 7fdf0de3f700 0 -- 172.21.15.69:0/1531198554 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55d81df97730 msgr2=0x55d81df6f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:25.479 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.481 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.482 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.22 2023-09-28T13:18:25.569 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.568+0000 7fbc7729b700 0 -- 172.21.15.69:0/1942164792 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fbc5c03a3e0 msgr2=0x7fbc5c03c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.585 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.23 2023-09-28T13:18:25.686 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.686+0000 7f9dc9074700 0 -- 172.21.15.69:0/562525751 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f9da4008740 msgr2=0x7f9da400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.688 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.690 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.691 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.24 2023-09-28T13:18:25.781 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.780+0000 7f92be828700 0 -- 172.21.15.69:0/2478848787 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f92a403a360 msgr2=0x7f92a403c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.791 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.794 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.794 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.25 2023-09-28T13:18:25.902 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:25.901+0000 7fa4ce78f700 0 -- 172.21.15.69:0/3285501016 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fa4b4006510 msgr2=0x7fa4b4011ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:25.902 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:25.905 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:25.905 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.26 2023-09-28T13:18:26.001 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.001+0000 7f40495db700 0 -- 172.21.15.69:0/1779994056 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f402c03a310 msgr2=0x7f402c03c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:26.015 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.018 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.27 2023-09-28T13:18:26.121 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.120+0000 7feb4ebfd700 0 -- 172.21.15.69:0/522467272 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7feb2c008740 msgr2=0x7feb2c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:26.121 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.28 2023-09-28T13:18:26.222 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.221+0000 7f825535c700 0 -- 172.21.15.69:0/323177799 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x558302116ae0 msgr2=0x5583020f27c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:26.223 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.29 2023-09-28T13:18:26.324 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.323+0000 7f56da077700 0 -- 172.21.15.69:0/3112508321 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f56c0008740 msgr2=0x7f56c000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:26.324 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.327 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.30 2023-09-28T13:18:26.434 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.433+0000 7ff1f3ea7700 0 -- 172.21.15.69:0/2549275352 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7ff1d0008740 msgr2=0x7ff1d000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:26.434 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.437 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.437 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.31 2023-09-28T13:18:26.536 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.535+0000 7fb651786700 0 -- 172.21.15.69:0/187070761 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fb62c008740 msgr2=0x7fb62c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:26.536 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.539 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.539 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.32 2023-09-28T13:18:26.625 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.624+0000 7ff3e38b8700 0 -- 172.21.15.69:0/4174545661 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7ff3c0006500 msgr2=0x7ff3c0011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:26.626 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.628 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.629 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.33 2023-09-28T13:18:26.745 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.745+0000 7f251d027700 0 -- 172.21.15.69:0/1103753844 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f24f8008740 msgr2=0x7f24f800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:26.748 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.34 2023-09-28T13:18:26.841 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:26.840+0000 7f8882217700 0 -- 172.21.15.69:0/3314795611 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f8868008740 msgr2=0x7f886800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:26.841 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:26.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:26.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.35 2023-09-28T13:18:27.001 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.000+0000 7f10c897f700 0 -- 172.21.15.69:0/42611352 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f10a4008740 msgr2=0x7f10a400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.002 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.005 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.005 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.36 2023-09-28T13:18:27.136 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.135+0000 7f4da3e4e700 0 -- 172.21.15.69:0/542446329 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55893d06e0c0 msgr2=0x55893d090c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.137 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.139 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.140 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.37 2023-09-28T13:18:27.237 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.236+0000 7f1dad9a3700 0 -- 172.21.15.69:0/1422734838 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f1d94008740 msgr2=0x7f1d9400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.237 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.38 2023-09-28T13:18:27.348 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.347+0000 7f8e282e8700 0 -- 172.21.15.69:0/2788027405 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f8e04008740 msgr2=0x7f8e0400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.348 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.351 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.351 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.39 2023-09-28T13:18:27.441 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.441+0000 7f8d22790700 0 -- 172.21.15.69:0/81492235 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x56412b6de990 msgr2=0x56412b6b65c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.442 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.445 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.445 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.40 2023-09-28T13:18:27.537 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.536+0000 7fce8577f700 0 -- 172.21.15.69:0/464382137 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fce6803a310 msgr2=0x7fce6803c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.545 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.548 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.548 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.41 2023-09-28T13:18:27.665 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.664+0000 7f60b2df3700 0 -- 172.21.15.69:0/2646640453 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55ce16276ac0 msgr2=0x55ce1622c2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.665 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.668 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.42 2023-09-28T13:18:27.770 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.769+0000 7fbbf41b1700 0 -- 172.21.15.69:0/2941314335 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x56463e2b1510 msgr2=0x56463e288340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.771 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.43 2023-09-28T13:18:27.881 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.881+0000 7f9613c54700 0 -- 172.21.15.69:0/3218410171 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f95f0008740 msgr2=0x7f95f000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.882 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:27.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:27.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.44 2023-09-28T13:18:27.996 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:27.996+0000 7f8387c1c700 0 -- 172.21.15.69:0/2892467497 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f8364006500 msgr2=0x7f8364011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:27.997 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.000 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.000 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.45 2023-09-28T13:18:28.097 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.096+0000 7f878e77f700 0 -- 172.21.15.69:0/2853618412 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55aa4a94d980 msgr2=0x55aa4a9f3960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.100 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.103 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.46 2023-09-28T13:18:28.203 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.202+0000 7fa6c4ce1700 0 -- 172.21.15.69:0/930526703 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fa6a0008740 msgr2=0x7fa6a000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.203 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.206 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.206 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.47 2023-09-28T13:18:28.315 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.314+0000 7f41320f4700 0 -- 172.21.15.69:0/4023888022 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f411403a360 msgr2=0x7f411403c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.320 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.322 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.323 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.48 2023-09-28T13:18:28.412 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.412+0000 7fc1ff5b9700 0 -- 172.21.15.69:0/1951393187 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fc1dc008740 msgr2=0x7fc1dc00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.413 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.416 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.416 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.49 2023-09-28T13:18:28.508 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.507+0000 7f508e068700 0 -- 172.21.15.69:0/825219434 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f5074008740 msgr2=0x7f507400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.508 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.510 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.510 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.50 2023-09-28T13:18:28.625 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.624+0000 7f042862e700 0 -- 172.21.15.69:0/1333638739 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f04040065b0 msgr2=0x7f0404011ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.625 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.628 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.628 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.51 2023-09-28T13:18:28.723 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.722+0000 7efcf2ab3700 0 -- 172.21.15.69:0/3024472339 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55f3961ed090 msgr2=0x55f396201b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.725 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.728 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.728 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.52 2023-09-28T13:18:28.818 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.817+0000 7fa3e661e700 0 -- 172.21.15.69:0/2652827046 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fa3cc008740 msgr2=0x7fa3cc00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.819 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.821 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.822 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.53 2023-09-28T13:18:28.945 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:28.944+0000 7f81457fc700 0 -- 172.21.15.69:0/3531892371 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f8120008740 msgr2=0x7f812000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:28.946 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:28.948 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:28.948 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.54 2023-09-28T13:18:29.052 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.051+0000 7f6cf0ac4700 0 -- 172.21.15.69:0/3630250423 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x562a02ddebd0 msgr2=0x562a02e7f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.053 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.056 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.056 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.55 2023-09-28T13:18:29.161 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.160+0000 7f850fb4d700 0 -- 172.21.15.69:0/1559561109 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f84f4008740 msgr2=0x7f84f400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.161 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.164 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.164 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.56 2023-09-28T13:18:29.274 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.274+0000 7f02a4201700 0 -- 172.21.15.69:0/2653831905 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f02880065b0 msgr2=0x7f0288011ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.275 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.277 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.277 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.57 2023-09-28T13:18:29.374 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.373+0000 7f7895f0d700 0 -- 172.21.15.69:0/1789123951 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f787c0065b0 msgr2=0x7f787c011ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.374 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.58 2023-09-28T13:18:29.504 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.504+0000 7fd7c08be700 0 -- 172.21.15.69:0/1784046830 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fd79c008740 msgr2=0x7fd79c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.505 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.507 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.507 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.59 2023-09-28T13:18:29.623 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.622+0000 7f2ebe31b700 0 -- 172.21.15.69:0/1891500734 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f2ea4008740 msgr2=0x7f2ea400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.624 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.60 2023-09-28T13:18:29.724 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.723+0000 7f57c75eb700 0 -- 172.21.15.69:0/1054502170 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f57a4008740 msgr2=0x7f57a400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.724 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.727 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.727 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.61 2023-09-28T13:18:29.837 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.836+0000 7f032ff25700 0 -- 172.21.15.69:0/351199917 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f030c008740 msgr2=0x7f030c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.838 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.840 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.841 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.62 2023-09-28T13:18:29.944 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:29.943+0000 7f202a770700 0 -- 172.21.15.69:0/3253278099 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55ec35199a60 msgr2=0x55ec3519bec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:29.944 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:29.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:29.947 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.63 2023-09-28T13:18:30.062 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.061+0000 7f10539ab700 0 -- 172.21.15.69:0/1591255388 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f1034005fd0 msgr2=0x7f1034008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:30.062 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.065 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.065 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.64 2023-09-28T13:18:30.154 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.153+0000 7f2cc408e700 0 -- 172.21.15.69:0/298879932 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55c9c5f157b0 msgr2=0x55c9c5fbb5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:30.156 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.159 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.159 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.65 2023-09-28T13:18:30.272 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.271+0000 7f8c1e5d9700 0 -- 172.21.15.69:0/588185100 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55e62bbbf7b0 msgr2=0x55e62bc655f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:30.274 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.277 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.277 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.66 2023-09-28T13:18:30.375 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.374+0000 7fee7ee40700 0 -- 172.21.15.69:0/473811896 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fee5c006510 msgr2=0x7fee5c011ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:30.376 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.379 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.379 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.67 2023-09-28T13:18:30.492 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.491+0000 7f174586b700 0 -- 172.21.15.69:0/1418538947 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55fdc9fb1aa0 msgr2=0x55fdc9f9d5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:30.492 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.495 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.495 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.68 2023-09-28T13:18:30.586 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.585+0000 7fb0b8292700 0 -- 172.21.15.69:0/4163703500 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55699cb40840 msgr2=0x55699cb43200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:30.586 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.589 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.589 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.69 2023-09-28T13:18:30.698 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.698+0000 7f9e2f306700 0 -- 172.21.15.69:0/3954886407 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f9e0c008740 msgr2=0x7f9e0c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:30.699 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.70 2023-09-28T13:18:30.794 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:30.793+0000 7f3f8303b700 0 -- 172.21.15.69:0/1940489440 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f3f64005fb0 msgr2=0x7f3f64008460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:30.795 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:30.797 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:30.797 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.71 2023-09-28T13:18:31.104 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.104+0000 7f8c2fa55700 0 -- 172.21.15.69:0/257765204 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f8c1403a280 msgr2=0x7f8c1403c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:31.113 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.115 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.115 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.72 2023-09-28T13:18:31.219 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.218+0000 7f8c83923700 0 -- 172.21.15.69:0/3362265270 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x555d0a002ba0 msgr2=0x555d09fe07b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:31.219 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.221 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.222 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.73 2023-09-28T13:18:31.331 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.330+0000 7f2343a05700 0 -- 172.21.15.69:0/1949603048 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f2320008740 msgr2=0x7f232000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:31.331 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.334 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.334 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.74 2023-09-28T13:18:31.480 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.479+0000 7fde67109700 0 -- 172.21.15.69:0/726116316 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fde4c008740 msgr2=0x7fde4c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:31.480 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.483 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.483 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.75 2023-09-28T13:18:31.606 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.606+0000 7fbbe8573700 0 -- 172.21.15.69:0/3156162041 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fbbc4008740 msgr2=0x7fbbc400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:31.607 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.610 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.610 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.76 2023-09-28T13:18:31.713 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.712+0000 7fee16019700 0 -- 172.21.15.69:0/2028430035 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fedfc008740 msgr2=0x7fedfc00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:31.713 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.716 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.77 2023-09-28T13:18:31.832 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.831+0000 7f2c55987700 0 -- 172.21.15.69:0/3335314760 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x563e4913ead0 msgr2=0x563e49117380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:31.832 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.78 2023-09-28T13:18:31.938 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:31.937+0000 7fb34e231700 0 -- 172.21.15.69:0/3996293613 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x558aeb770a20 msgr2=0x558aeb74cb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:31.938 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:31.941 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:31.941 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.79 2023-09-28T13:18:32.049 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.048+0000 7f9173399700 0 -- 172.21.15.69:0/274598987 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f9158008740 msgr2=0x7f915800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.049 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.80 2023-09-28T13:18:32.165 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.164+0000 7fe23cae6700 0 -- 172.21.15.69:0/1481097749 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fe218008740 msgr2=0x7fe21800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:32.166 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.168 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.168 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.81 2023-09-28T13:18:32.267 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.266+0000 7f00585c0700 0 -- 172.21.15.69:0/2465259080 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x5581d8d749c0 msgr2=0x5581d8d2b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.267 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.270 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.270 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.82 2023-09-28T13:18:32.364 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.364+0000 7f3987e6e700 0 -- 172.21.15.69:0/120748340 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f3964008740 msgr2=0x7f396400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.365 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.83 2023-09-28T13:18:32.478 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.477+0000 7f0431207700 0 -- 172.21.15.69:0/2387636937 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f040c008740 msgr2=0x7f040c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.478 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.482 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.482 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.84 2023-09-28T13:18:32.577 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.576+0000 7f90491a6700 0 -- 172.21.15.69:0/586867708 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f9028005fb0 msgr2=0x7f9028008460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.578 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.580 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.581 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.85 2023-09-28T13:18:32.701 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.700+0000 7fbf77085700 0 -- 172.21.15.69:0/3435602452 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fbf5c0064f0 msgr2=0x7fbf5c011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.701 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.704 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.704 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.86 2023-09-28T13:18:32.797 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.796+0000 7fd4a8528700 0 -- 172.21.15.69:0/212377279 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fd48c008740 msgr2=0x7fd48c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.805 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.808 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.808 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.87 2023-09-28T13:18:32.908 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:32.907+0000 7facc2bbb700 0 -- 172.21.15.69:0/1791744964 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7faca0006510 msgr2=0x7faca0011ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:32.908 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:32.911 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:32.911 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.88 2023-09-28T13:18:33.019 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.019+0000 7f834ed7e700 0 -- 172.21.15.69:0/1664893405 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f832c008740 msgr2=0x7f832c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.020 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.023 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.023 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.89 2023-09-28T13:18:33.111 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.110+0000 7fce27787700 0 -- 172.21.15.69:0/2329181471 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fce0c03a360 msgr2=0x7fce0c03c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.120 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.90 2023-09-28T13:18:33.221 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.220+0000 7f2a6cde2700 0 -- 172.21.15.69:0/1855695674 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55e216789b40 msgr2=0x55e21673f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.222 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.225 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.225 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.91 2023-09-28T13:18:33.332 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.332+0000 7f0af4de7700 0 -- 172.21.15.69:0/4212649707 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x5623087e3950 msgr2=0x5623087bc170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.333 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.336 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.336 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.92 2023-09-28T13:18:33.430 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.430+0000 7ff3a8573700 0 -- 172.21.15.69:0/3404322636 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7ff384008740 msgr2=0x7ff38400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.431 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.93 2023-09-28T13:18:33.529 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.528+0000 7f97ececb700 0 -- 172.21.15.69:0/1226794418 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f97c8006500 msgr2=0x7f97c8011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.530 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.532 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.532 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.94 2023-09-28T13:18:33.639 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.639+0000 7fdfff8af700 0 -- 172.21.15.69:0/4100915937 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fdfe403a290 msgr2=0x7fdfe403c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.645 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.648 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.648 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.95 2023-09-28T13:18:33.746 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.746+0000 7f96edef0700 0 -- 172.21.15.69:0/2365396596 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f96d4008740 msgr2=0x7f96d400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.747 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.96 2023-09-28T13:18:33.847 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.846+0000 7f3d6f6c3700 0 -- 172.21.15.69:0/351155084 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f3d4c008740 msgr2=0x7f3d4c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.847 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.97 2023-09-28T13:18:33.961 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:33.960+0000 7f604e3c6700 0 -- 172.21.15.69:0/851534043 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f6034008740 msgr2=0x7f603400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:33.961 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:33.964 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:33.964 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.98 2023-09-28T13:18:34.059 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:34.058+0000 7fe40cee3700 0 -- 172.21.15.69:0/685136588 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fe3e8008740 msgr2=0x7fe3e800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:34.060 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:34.062 INFO:tasks.workunit.client.0.smithi069.stderr:+ for i in $(seq -w 00 99) 2023-09-28T13:18:34.062 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm image.99 2023-09-28T13:18:34.155 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:34.154+0000 7f15ac429700 0 -- 172.21.15.69:0/639232816 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f1588008740 msgr2=0x7f158800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:34.156 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:34.158 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_remove 2023-09-28T13:18:34.159 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing remove...' 2023-09-28T13:18:34.159 INFO:tasks.workunit.client.0.smithi069.stdout:testing remove... 2023-09-28T13:18:34.159 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:18:34.159 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.236 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.316 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.395 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.473 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.550 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.623 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.698 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.921 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:34.995 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:35.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:35.145 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:35.221 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:35.296 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:35.372 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:35.448 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:35.524 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd remove NOT_EXIST 2023-09-28T13:18:35.564 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 0% complete...failed. 2023-09-28T13:18:35.564 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: delete error: (2) No such file or directory 2023-09-28T13:18:35.567 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:18:35.567 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 1 -s 1 test1 2023-09-28T13:18:35.589 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:35.595 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:35.594+0000 7f90d9ed1500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:35.602 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:18:35.642 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:35.646 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:35.646 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:35.646 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:18:35.676 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:18:35.677 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test2 2023-09-28T13:18:35.727 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:35.834 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:35.833+0000 7f1881ad2700 0 -- 172.21.15.69:0/339600970 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x5570bed11c50 msgr2=0x5570bece66c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:35.834 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:35.837 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:35.837 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:35.837 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:18:35.864 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:18:35.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 1 -s 1 test1 2023-09-28T13:18:35.887 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:35.892 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:35.892+0000 7f1b0f995500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:35.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ rados rm -p rbd test1.rbd 2023-09-28T13:18:35.929 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:18:35.958 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:35.961 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:35.961 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:35.961 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:18:35.987 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:18:35.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 1 -eq 0 ']' 2023-09-28T13:18:35.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test2 2023-09-28T13:18:36.032 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test2@snap 2023-09-28T13:18:36.763 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:18:36.770 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect test2@snap 2023-09-28T13:18:36.809 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2023-09-28T13:18:36.871 INFO:tasks.workunit.client.0.smithi069.stderr:+ rados -p rbd rm rbd_children 2023-09-28T13:18:36.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm clone 2023-09-28T13:18:36.995 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:36.994+0000 7f8a1aada700 0 -- 172.21.15.69:0/3697363941 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f89f8008740 msgr2=0x7f89f800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:36.996 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:36.999 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:36.999 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep clone 2023-09-28T13:18:36.999 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:36.999 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:18:37.026 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:18:37.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect test2@snap 2023-09-28T13:18:37.069 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm test2@snap 2023-09-28T13:18:37.759 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:18:37.777 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:37.871 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:37.870+0000 7f4e23be2700 0 -- 172.21.15.69:0/1334543168 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f4e00006470 msgr2=0x7f4e00011e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:37.872 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:37.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_migration 2023-09-28T13:18:37.874 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing migration...' 2023-09-28T13:18:37.875 INFO:tasks.workunit.client.0.smithi069.stdout:testing migration... 2023-09-28T13:18:37.875 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:18:37.875 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:37.950 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.043 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.198 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.280 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.357 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.432 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.509 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.586 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.664 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:38.979 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:39.054 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:39.134 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:39.208 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:18:39.283 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool create rbd2 8 2023-09-28T13:18:39.887 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'rbd2' already exists 2023-09-28T13:18:39.896 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd pool init rbd2 2023-09-28T13:18:42.783 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 1 -s 128M test1 2023-09-28T13:18:42.808 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:42.816 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:42.815+0000 7fba9f5d5500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:42.827 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info test1 2023-09-28T13:18:42.827 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'format: 1' 2023-09-28T13:18:42.861 INFO:tasks.workunit.client.0.smithi069.stdout: format: 1 2023-09-28T13:18:42.862 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test1 --image-format 2 2023-09-28T13:18:42.940 INFO:tasks.workunit.client.0.smithi069.stderr:++ get_migration_state test1 2023-09-28T13:18:42.941 INFO:tasks.workunit.client.0.smithi069.stderr:++ local image=test1 2023-09-28T13:18:42.941 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd --format xml status test1 2023-09-28T13:18:42.941 INFO:tasks.workunit.client.0.smithi069.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-09-28T13:18:43.022 INFO:tasks.workunit.client.0.smithi069.stderr:+ test prepared = prepared 2023-09-28T13:18:43.022 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info test1 2023-09-28T13:18:43.023 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'format: 2' 2023-09-28T13:18:43.060 INFO:tasks.workunit.client.0.smithi069.stdout: format: 2 2023-09-28T13:18:43.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:18:43.094 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:43.094+0000 7f333346a500 -1 librbd::image::PreRemoveRequest: 0x55eca9283700 validate_image_removal: image in migration state - not removing 2023-09-28T13:18:43.097 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 0% complete...failed. 2023-09-28T13:18:43.097 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: error: image still has watchers 2023-09-28T13:18:43.097 INFO:tasks.workunit.client.0.smithi069.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-09-28T13:18:43.100 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:18:43.100 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test1 2023-09-28T13:18:43.205 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:18:43.204+0000 7f2f5e5bd700 0 -- 172.21.15.69:0/294621074 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f2f38004be0 msgr2=0x7f2f38006fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:43.230 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:43.229+0000 7f2f5edbe700 0 -- 172.21.15.69:0/294621074 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x555c2d7f57b0 msgr2=0x555c2d8f1fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:43.255 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:43.258 INFO:tasks.workunit.client.0.smithi069.stderr:++ get_migration_state test1 2023-09-28T13:18:43.258 INFO:tasks.workunit.client.0.smithi069.stderr:++ local image=test1 2023-09-28T13:18:43.258 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd --format xml status test1 2023-09-28T13:18:43.258 INFO:tasks.workunit.client.0.smithi069.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-09-28T13:18:43.320 INFO:tasks.workunit.client.0.smithi069.stderr:+ test executed = executed 2023-09-28T13:18:43.320 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 2023-09-28T13:18:43.409 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete...2023-09-28T13:18:43.409+0000 7f44c15ea700 0 -- 172.21.15.69:0/4183459684 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f44a0004bb0 msgr2=0x7f44a0006f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:43.419 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-09-28T13:18:43.419+0000 7f44c1deb700 0 -- 172.21.15.69:0/4183459684 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x564fc63f8680 msgr2=0x564fc64ee970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:43.430 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 100% complete...done. 2023-09-28T13:18:43.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ get_migration_state test1 2023-09-28T13:18:43.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ local image=test1 2023-09-28T13:18:43.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --format xml status test1 2023-09-28T13:18:43.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ xmlstarlet sel -t -v //status/migration/state 2023-09-28T13:18:43.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:18:43.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info test1 2023-09-28T13:18:43.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'features: .*layering' 2023-09-28T13:18:43.502 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:18:43.503 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2023-09-28T13:18:43.607 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info test1 2023-09-28T13:18:43.608 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'features: .*layering' 2023-09-28T13:18:43.647 INFO:tasks.workunit.client.0.smithi069.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2023-09-28T13:18:43.647 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test1 2023-09-28T13:18:43.736 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:18:43.735+0000 7f086b922700 0 -- 172.21.15.69:0/3139398307 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x561314d1c7b0 msgr2=0x561314e117f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:43.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:18:43.738+0000 7f96ea87f700 -1 reset not still connected to 0x56355f36cb60 2023-09-28T13:18:43.765 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:43.764+0000 7f086b922700 0 -- 172.21.15.69:0/3139398307 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f084c03ab40 msgr2=0x7f084c03cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:43.770 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:43.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 2023-09-28T13:18:43.862 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:43.862+0000 7fae7e79d700 0 -- 172.21.15.69:0/1001115172 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fae58004bb0 msgr2=0x7fae58006f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:43.874 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete...2023-09-28T13:18:43.873+0000 7fae7ef9e700 0 -- 172.21.15.69:0/1001115172 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55ea407ad680 msgr2=0x55ea408a3b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:43.895 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-09-28T13:18:43.898 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test1 rbd2/test1 2023-09-28T13:18:43.997 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:43.997+0000 7f71dd9e1700 0 -- 172.21.15.69:0/3459527068 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f71c003ab40 msgr2=0x7f71c003cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:44.013 INFO:tasks.workunit.client.0.smithi069.stderr:++ get_migration_state rbd2/test1 2023-09-28T13:18:44.014 INFO:tasks.workunit.client.0.smithi069.stderr:++ local image=rbd2/test1 2023-09-28T13:18:44.014 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd --format xml status rbd2/test1 2023-09-28T13:18:44.014 INFO:tasks.workunit.client.0.smithi069.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-09-28T13:18:44.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ test prepared = prepared 2023-09-28T13:18:44.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:18:44.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:18:44.089 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:18:44.115 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:18:44.116 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd -p rbd2 ls 2023-09-28T13:18:44.116 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:18:44.144 INFO:tasks.workunit.client.0.smithi069.stdout:test1 2023-09-28T13:18:44.144 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test1 2023-09-28T13:18:44.239 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:18:44.239+0000 7f458d60c700 0 -- 172.21.15.69:0/1344416756 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x5597a756a7b0 msgr2=0x5597a765f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:44.247 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:44.251 INFO:tasks.workunit.client.0.smithi069.stderr:++ get_migration_state rbd2/test1 2023-09-28T13:18:44.251 INFO:tasks.workunit.client.0.smithi069.stderr:++ local image=rbd2/test1 2023-09-28T13:18:44.251 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd --format xml status rbd2/test1 2023-09-28T13:18:44.251 INFO:tasks.workunit.client.0.smithi069.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-09-28T13:18:44.312 INFO:tasks.workunit.client.0.smithi069.stderr:+ test executed = executed 2023-09-28T13:18:44.312 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm rbd2/test1 2023-09-28T13:18:44.349 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:44.348+0000 7fdbeffff700 -1 librbd::image::PreRemoveRequest: 0x5597afad5960 validate_image_removal: image in migration state - not removing 2023-09-28T13:18:44.353 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 0% complete...failed. 2023-09-28T13:18:44.353 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: error: image still has watchers 2023-09-28T13:18:44.353 INFO:tasks.workunit.client.0.smithi069.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-09-28T13:18:44.355 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:18:44.356 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 2023-09-28T13:18:44.441 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-09-28T13:18:44.440+0000 7f145698a700 0 -- 172.21.15.69:0/3195557924 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x558961da1680 msgr2=0x558961e97b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:44.457 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 100% complete...done. 2023-09-28T13:18:44.460 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace create rbd2/ns1 2023-09-28T13:18:44.491 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace create rbd2/ns2 2023-09-28T13:18:44.522 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2023-09-28T13:18:44.620 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:44.620+0000 7fc3f5f9d700 0 -- 172.21.15.69:0/1156430073 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55a09a4c6fa0 msgr2=0x55a09a5687b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:44.629 INFO:tasks.workunit.client.0.smithi069.stderr:++ get_migration_state rbd2/ns1/test1 2023-09-28T13:18:44.629 INFO:tasks.workunit.client.0.smithi069.stderr:++ local image=rbd2/ns1/test1 2023-09-28T13:18:44.629 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-09-28T13:18:44.630 INFO:tasks.workunit.client.0.smithi069.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-09-28T13:18:44.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ test prepared = prepared 2023-09-28T13:18:44.702 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute rbd2/test1 2023-09-28T13:18:44.769 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:18:44.768+0000 7f7ad29c4700 0 -- 172.21.15.69:0/3304527727 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55c53f484930 msgr2=0x55c53f575730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:44.772 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:44.775 INFO:tasks.workunit.client.0.smithi069.stderr:++ get_migration_state rbd2/ns1/test1 2023-09-28T13:18:44.775 INFO:tasks.workunit.client.0.smithi069.stderr:++ local image=rbd2/ns1/test1 2023-09-28T13:18:44.775 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-09-28T13:18:44.776 INFO:tasks.workunit.client.0.smithi069.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-09-28T13:18:44.834 INFO:tasks.workunit.client.0.smithi069.stderr:+ test executed = executed 2023-09-28T13:18:44.834 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit rbd2/test1 2023-09-28T13:18:44.911 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-09-28T13:18:44.911+0000 7f8e50d1a700 0 -- 172.21.15.69:0/501812093 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55fe7ff73680 msgr2=0x55fe80069b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:44.920 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 100% complete...done. 2023-09-28T13:18:44.923 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2023-09-28T13:18:45.007 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.006+0000 7ff81a222700 0 -- 172.21.15.69:0/2438704163 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x557a4ad19fa0 msgr2=0x557a4adbb7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.016 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute rbd2/ns2/test1 2023-09-28T13:18:45.090 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:18:45.090+0000 7fb3619e1700 0 -- 172.21.15.69:0/4146966822 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x561d72a6afa0 msgr2=0x561d72a6d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.104 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.103+0000 7fb3619e1700 0 -- 172.21.15.69:0/4146966822 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x561d72a0b610 msgr2=0x7fb34403fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.116 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:45.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit rbd2/ns2/test1 2023-09-28T13:18:45.194 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.194+0000 7fd24706f700 0 -- 172.21.15.69:0/3747124161 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55d2c138f420 msgr2=0x55d2c1391800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.201 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.201+0000 7fd247870700 0 -- 172.21.15.69:0/3747124161 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55d2c1297680 msgr2=0x55d2c1341eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.213 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-09-28T13:18:45.216 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M test1 2023-09-28T13:18:45.243 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.242+0000 7fbfb6cf7500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:45.250 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test1 --data-pool rbd2 2023-09-28T13:18:45.321 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info test1 2023-09-28T13:18:45.321 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'data_pool: rbd2' 2023-09-28T13:18:45.359 INFO:tasks.workunit.client.0.smithi069.stdout: data_pool: rbd2 2023-09-28T13:18:45.359 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test1 2023-09-28T13:18:45.438 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:18:45.437+0000 7f8227750700 0 -- 172.21.15.69:0/805448017 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x555cf88eb7b0 msgr2=0x555cf89e09b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.466 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.466+0000 7f8227750700 0 -- 172.21.15.69:0/805448017 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f820c03ab40 msgr2=0x7f820c03cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.477 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:45.480 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 2023-09-28T13:18:45.569 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete...2023-09-28T13:18:45.568+0000 7f5e828a6700 0 -- 172.21.15.69:0/963017179 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f5e64004be0 msgr2=0x7f5e64006fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.584 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-09-28T13:18:45.583+0000 7f5e830a7700 0 -- 172.21.15.69:0/963017179 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55dc6c1d8fd0 msgr2=0x55dc6c2cfc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.597 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 100% complete...done. 2023-09-28T13:18:45.600 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test1 2023-09-28T13:18:45.684 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd trash mv test1 2023-09-28T13:18:45.684 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv test1 2023-09-28T13:18:45.718 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.717+0000 7f74203ad500 -1 librbd::api::Trash: move: cannot move migrating image to trash 2023-09-28T13:18:45.720 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: deferred delete error: (16) Device or resource busy 2023-09-28T13:18:45.722 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:18:45.723 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls -a 2023-09-28T13:18:45.723 INFO:tasks.workunit.client.0.smithi069.stderr:++ cut -d ' ' -f 1 2023-09-28T13:18:45.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=19ef6a698bd2 2023-09-28T13:18:45.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd trash rm 19ef6a698bd2 2023-09-28T13:18:45.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash rm 19ef6a698bd2 2023-09-28T13:18:45.784 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.783+0000 7f65ca660700 -1 librbd::image::RefreshRequest: image being migrated 2023-09-28T13:18:45.784 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.783+0000 7f65ca660700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2023-09-28T13:18:45.785 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.783+0000 7f65c9e5f700 -1 librbd::ImageState: 0x7f65a404d9c0 failed to open image: (30) Read-only file system 2023-09-28T13:18:45.785 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.784+0000 7f65c0ff9700 -1 librbd::image::RemoveRequest: 0x7f65a4000b80 handle_open_image: error opening image: (30) Read-only file system 2023-09-28T13:18:45.786 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: remove error: (30) Read-only file system 2023-09-28T13:18:45.786 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 0% complete...failed. 2023-09-28T13:18:45.789 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:18:45.789 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd trash restore 19ef6a698bd2 2023-09-28T13:18:45.789 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash restore 19ef6a698bd2 2023-09-28T13:18:45.815 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: restore error: 2023-09-28T13:18:45.814+0000 7f0dd8c5e500 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2023-09-28T13:18:45.815 INFO:tasks.workunit.client.0.smithi069.stderr:(22) Invalid argument 2023-09-28T13:18:45.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:18:45.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test1 2023-09-28T13:18:45.913 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-09-28T13:18:45.912+0000 7f17ad760700 0 -- 172.21.15.69:0/1384700992 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55ccf50677b0 msgr2=0x55ccf515c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.946 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:45.945+0000 7f17ad760700 0 -- 172.21.15.69:0/1384700992 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f179003ab40 msgr2=0x7f179003cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:45.953 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 100% complete...done. 2023-09-28T13:18:45.956 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd remove test1 2023-09-28T13:18:46.058 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-09-28T13:18:46.061 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/dev/urandom bs=1M count=1 2023-09-28T13:18:46.061 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd --image-format 2 import - test1 2023-09-28T13:18:46.111 INFO:tasks.workunit.client.0.smithi069.stderr:1+0 records in 2023-09-28T13:18:46.111 INFO:tasks.workunit.client.0.smithi069.stderr:1+0 records out 2023-09-28T13:18:46.111 INFO:tasks.workunit.client.0.smithi069.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0488283 s, 21.5 MB/s 2023-09-28T13:18:46.143 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 100% complete...done. 2023-09-28T13:18:46.146 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd export test1 - 2023-09-28T13:18:46.146 INFO:tasks.workunit.client.0.smithi069.stderr:++ md5sum 2023-09-28T13:18:46.180 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:18:46.184 INFO:tasks.workunit.client.0.smithi069.stderr:+ md5sum='82ea7aefdac54c623cf57c6187145d1e -' 2023-09-28T13:18:46.184 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@snap1 2023-09-28T13:18:46.740 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:18:46.747 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect test1@snap1 2023-09-28T13:18:46.787 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@snap2 2023-09-28T13:18:47.788 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:18:47.796 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2023-09-28T13:18:47.860 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2023-09-28T13:18:47.926 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v1 2023-09-28T13:18:47.926 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-09-28T13:18:47.968 INFO:tasks.workunit.client.0.smithi069.stdout: parent: rbd/test1@snap1 2023-09-28T13:18:47.968 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v2 2023-09-28T13:18:47.968 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-09-28T13:18:48.008 INFO:tasks.workunit.client.0.smithi069.stdout: parent: rbd/test1@snap2 2023-09-28T13:18:48.009 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v2 2023-09-28T13:18:48.009 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'op_features: clone-child' 2023-09-28T13:18:48.050 INFO:tasks.workunit.client.0.smithi069.stdout: op_features: clone-child 2023-09-28T13:18:48.050 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd export clone_v1 - 2023-09-28T13:18:48.050 INFO:tasks.workunit.client.0.smithi069.stderr:++ md5sum 2023-09-28T13:18:48.091 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:18:48.094 INFO:tasks.workunit.client.0.smithi069.stderr:+ test '82ea7aefdac54c623cf57c6187145d1e -' = '82ea7aefdac54c623cf57c6187145d1e -' 2023-09-28T13:18:48.095 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd export clone_v2 - 2023-09-28T13:18:48.095 INFO:tasks.workunit.client.0.smithi069.stderr:++ md5sum 2023-09-28T13:18:48.135 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:18:48.138 INFO:tasks.workunit.client.0.smithi069.stderr:+ test '82ea7aefdac54c623cf57c6187145d1e -' = '82ea7aefdac54c623cf57c6187145d1e -' 2023-09-28T13:18:48.138 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd children test1@snap1 2023-09-28T13:18:48.181 INFO:tasks.workunit.client.0.smithi069.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-09-28T13:18:48.181 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd children test1@snap2 2023-09-28T13:18:48.215 INFO:tasks.workunit.client.0.smithi069.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-09-28T13:18:48.215 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test1 rbd2/test2 2023-09-28T13:18:48.302 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:48.301+0000 7f4f61157700 0 -- 172.21.15.69:0/1249652865 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f4f40004be0 msgr2=0x7f4f40005030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:49.793 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:49.792+0000 7f4f61157700 0 -- 172.21.15.69:0/1249652865 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f4f4403aa00 msgr2=0x7f4f4403cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:49.861 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v1 2023-09-28T13:18:49.861 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2023-09-28T13:18:49.915 INFO:tasks.workunit.client.0.smithi069.stdout: parent: rbd2/test2@snap1 2023-09-28T13:18:49.915 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v2 2023-09-28T13:18:49.915 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2023-09-28T13:18:49.969 INFO:tasks.workunit.client.0.smithi069.stdout: parent: rbd2/test2@snap2 2023-09-28T13:18:49.970 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v2 2023-09-28T13:18:49.970 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'op_features: clone-child' 2023-09-28T13:18:50.023 INFO:tasks.workunit.client.0.smithi069.stdout: op_features: clone-child 2023-09-28T13:18:50.024 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd children rbd2/test2@snap1 2023-09-28T13:18:50.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-09-28T13:18:50.080 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd children rbd2/test2@snap2 2023-09-28T13:18:50.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-09-28T13:18:50.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test1 2023-09-28T13:18:50.208 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:50.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd migration commit test1 2023-09-28T13:18:50.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 2023-09-28T13:18:50.276 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: the image has descendants: 2023-09-28T13:18:50.276 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v1 2023-09-28T13:18:50.276 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v2 2023-09-28T13:18:50.276 INFO:tasks.workunit.client.0.smithi069.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-09-28T13:18:50.276 INFO:tasks.workunit.client.0.smithi069.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-09-28T13:18:50.278 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:18:50.279 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 --force 2023-09-28T13:18:50.345 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: the image has descendants: 2023-09-28T13:18:50.345 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v1 2023-09-28T13:18:50.345 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v2 2023-09-28T13:18:50.345 INFO:tasks.workunit.client.0.smithi069.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-09-28T13:18:50.346 INFO:tasks.workunit.client.0.smithi069.stderr:Proceeding anyway due to force flag set. 2023-09-28T13:18:50.357 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:50.356+0000 7f9eb1909700 0 -- 172.21.15.69:0/3538415445 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x559fc6724100 msgr2=0x559fc67264e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:50.364 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:50.364+0000 7f9eb1909700 0 -- 172.21.15.69:0/3538415445 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f9e9403aa00 msgr2=0x7f9e9403cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:51.771 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 100% complete...done. 2023-09-28T13:18:51.775 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd export clone_v1 - 2023-09-28T13:18:51.775 INFO:tasks.workunit.client.0.smithi069.stderr:++ md5sum 2023-09-28T13:18:51.819 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:18:51.822 INFO:tasks.workunit.client.0.smithi069.stderr:+ test '82ea7aefdac54c623cf57c6187145d1e -' = '82ea7aefdac54c623cf57c6187145d1e -' 2023-09-28T13:18:51.822 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd export clone_v2 - 2023-09-28T13:18:51.823 INFO:tasks.workunit.client.0.smithi069.stderr:++ md5sum 2023-09-28T13:18:51.863 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:18:51.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ test '82ea7aefdac54c623cf57c6187145d1e -' = '82ea7aefdac54c623cf57c6187145d1e -' 2023-09-28T13:18:51.867 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare rbd2/test2 test1 2023-09-28T13:18:51.954 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:51.954+0000 7f258e39c700 0 -- 172.21.15.69:0/3930294346 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f2574008740 msgr2=0x7f257400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:53.811 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:53.811+0000 7f258e39c700 0 -- 172.21.15.69:0/3930294346 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f257003abc0 msgr2=0x7f257003cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:53.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v1 2023-09-28T13:18:53.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-09-28T13:18:53.953 INFO:tasks.workunit.client.0.smithi069.stdout: parent: rbd/test1@snap1 2023-09-28T13:18:53.953 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v2 2023-09-28T13:18:53.953 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-09-28T13:18:54.007 INFO:tasks.workunit.client.0.smithi069.stdout: parent: rbd/test1@snap2 2023-09-28T13:18:54.007 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info clone_v2 2023-09-28T13:18:54.007 INFO:tasks.workunit.client.0.smithi069.stderr:+ fgrep 'op_features: clone-child' 2023-09-28T13:18:54.063 INFO:tasks.workunit.client.0.smithi069.stdout: op_features: clone-child 2023-09-28T13:18:54.063 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd children test1@snap1 2023-09-28T13:18:54.120 INFO:tasks.workunit.client.0.smithi069.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-09-28T13:18:54.120 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd children test1@snap2 2023-09-28T13:18:54.169 INFO:tasks.workunit.client.0.smithi069.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-09-28T13:18:54.170 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test1 2023-09-28T13:18:54.268 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:54.268+0000 7f094b211700 0 -- 172.21.15.69:0/4169782814 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f0928008740 msgr2=0x7f092800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:54.272 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:54.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd migration commit test1 2023-09-28T13:18:54.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 2023-09-28T13:18:54.351 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: the image has descendants: 2023-09-28T13:18:54.351 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v1 2023-09-28T13:18:54.351 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v2 2023-09-28T13:18:54.351 INFO:tasks.workunit.client.0.smithi069.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-09-28T13:18:54.351 INFO:tasks.workunit.client.0.smithi069.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-09-28T13:18:54.354 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:18:54.354 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration commit test1 --force 2023-09-28T13:18:54.432 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: the image has descendants: 2023-09-28T13:18:54.433 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v1 2023-09-28T13:18:54.433 INFO:tasks.workunit.client.0.smithi069.stderr: rbd/clone_v2 2023-09-28T13:18:54.433 INFO:tasks.workunit.client.0.smithi069.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-09-28T13:18:54.433 INFO:tasks.workunit.client.0.smithi069.stderr:Proceeding anyway due to force flag set. 2023-09-28T13:18:54.435 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:54.436+0000 7f7b8461d700 0 -- 172.21.15.69:0/705954326 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f7b60008740 msgr2=0x7f7b6000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:54.447 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:54.447+0000 7f7b8461d700 0 -- 172.21.15.69:0/705954326 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f7b6803aa60 msgr2=0x7f7b6803ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:55.849 INFO:tasks.workunit.client.0.smithi069.stderr: Commit image migration: 100% complete...done. 2023-09-28T13:18:55.853 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd export clone_v1 - 2023-09-28T13:18:55.853 INFO:tasks.workunit.client.0.smithi069.stderr:++ md5sum 2023-09-28T13:18:55.895 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:18:55.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ test '82ea7aefdac54c623cf57c6187145d1e -' = '82ea7aefdac54c623cf57c6187145d1e -' 2023-09-28T13:18:55.900 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd export clone_v2 - 2023-09-28T13:18:55.900 INFO:tasks.workunit.client.0.smithi069.stderr:++ md5sum 2023-09-28T13:18:55.940 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:18:55.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ test '82ea7aefdac54c623cf57c6187145d1e -' = '82ea7aefdac54c623cf57c6187145d1e -' 2023-09-28T13:18:55.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd remove clone_v1 2023-09-28T13:18:56.038 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:56.039+0000 7fc689fe3700 0 -- 172.21.15.69:0/1504248443 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x564e1bb1fbd0 msgr2=0x564e1bbc0af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:56.041 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:56.043 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd remove clone_v2 2023-09-28T13:18:56.157 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:56.157+0000 7fe0bc7c8700 0 -- 172.21.15.69:0/2988957871 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fe098008740 msgr2=0x7fe09800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:56.173 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:56.176 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect test1@snap1 2023-09-28T13:18:56.222 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge test1 2023-09-28T13:18:57.733 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:18:57.747 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:18:57.864 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:57.864+0000 7f3b3e2de700 0 -- 172.21.15.69:0/3836870758 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f3b18005fd0 msgr2=0x7f3b18008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:18:57.873 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:18:57.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ for format in 1 2 2023-09-28T13:18:57.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 1 test2 2023-09-28T13:18:57.899 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:57.905 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:57.905+0000 7f050a617500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:57.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-09-28T13:18:58.064 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:18:58.107 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:58.112 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:58.112 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 200.004 bytes/sec: 200 KiB/s 2023-09-28T13:18:58.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test2 2023-09-28T13:18:58.189 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-09-28T13:18:58.189+0000 7fce10d98700 0 -- 172.21.15.69:0/498757066 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x559fc2e91620 msgr2=0x559fc2ef0e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:58.203 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 100% complete...done. 2023-09-28T13:18:58.206 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:18:58.242 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:58.247 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:58.248 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 166.67 bytes/sec: 167 KiB/s 2023-09-28T13:18:58.253 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:58.311 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-09-28T13:18:58.313 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 1 test2 2023-09-28T13:18:58.336 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:58.543 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:58.544+0000 7fb2d3e0e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:58.551 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-09-28T13:18:58.629 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:18:58.671 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:58.674 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:58.674 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-09-28T13:18:58.679 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test2 2023-09-28T13:18:58.768 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:18:58.768+0000 7f432a41e700 0 -- 172.21.15.69:0/1944331822 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x5628670cd610 msgr2=0x56286712b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:58.788 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:58.789+0000 7f4329c1d700 0 -- 172.21.15.69:0/1944331822 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f4310008740 msgr2=0x7f431000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:58.802 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:18:58.804 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test2 2023-09-28T13:18:58.884 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-09-28T13:18:58.885+0000 7f32d3c95700 0 -- 172.21.15.69:0/1823268025 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f32b00088b0 msgr2=0x7f32b000ad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:58.899 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 100% complete...done. 2023-09-28T13:18:58.901 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:18:58.939 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:58.941 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:58.942 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-09-28T13:18:58.946 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:59.000 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-09-28T13:18:59.003 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 1 test2 2023-09-28T13:18:59.026 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:59.032 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:59.032+0000 7f343bdae500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:59.038 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-09-28T13:18:59.080 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:59.080+0000 7f7ec1e5b500 -1 librbd::image::CreateRequest: 0x557d00947f50 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-09-28T13:18:59.080 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:59.080+0000 7f7ec1e5b500 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-09-28T13:18:59.087 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-09-28T13:18:59.090 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:18:59.090 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:18:59.125 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:59.128 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:59.129 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 333.34 bytes/sec: 333 KiB/s 2023-09-28T13:18:59.134 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:59.193 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-09-28T13:18:59.195 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 1 test2 2023-09-28T13:18:59.219 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:59.224 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:59.225+0000 7f633427f500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:59.231 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 rbd2/test2 2023-09-28T13:18:59.298 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-09-28T13:18:59.339 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:59.343 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:59.343 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 333.34 bytes/sec: 333 KiB/s 2023-09-28T13:18:59.351 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test2 2023-09-28T13:18:59.433 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-09-28T13:18:59.436 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:18:59.472 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:59.477 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:59.477 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 166.67 bytes/sec: 167 KiB/s 2023-09-28T13:18:59.483 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:59.532 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-09-28T13:18:59.535 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 1 test2 2023-09-28T13:18:59.558 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image format 1 is deprecated 2023-09-28T13:18:59.565 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:18:59.565+0000 7f9b5f677500 -1 librbd: Forced V1 image creation. 2023-09-28T13:18:59.572 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 rbd2/test2 2023-09-28T13:18:59.636 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort rbd2/test2 2023-09-28T13:18:59.713 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-09-28T13:18:59.714+0000 7fdd6d092700 0 -- 172.21.15.69:0/320033200 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fdd4c004be0 msgr2=0x7fdd4c006fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:18:59.730 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 100% complete...done. 2023-09-28T13:18:59.733 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:18:59.769 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:18:59.774 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:18:59.775 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 200.004 bytes/sec: 200 KiB/s 2023-09-28T13:18:59.783 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:18:59.844 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-09-28T13:18:59.847 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 1 = 1 2023-09-28T13:18:59.847 INFO:tasks.workunit.client.0.smithi069.stderr:+ continue 2023-09-28T13:18:59.848 INFO:tasks.workunit.client.0.smithi069.stderr:+ for format in 1 2 2023-09-28T13:18:59.848 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 2 test2 2023-09-28T13:18:59.891 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-09-28T13:19:00.012 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:00.013+0000 7f3caa812700 0 -- 172.21.15.69:0/2279854163 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x561eb4ddd6d0 msgr2=0x561eb4dde9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:00.017 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:00.065 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:00.070 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:00.070 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-09-28T13:19:00.077 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test2 2023-09-28T13:19:00.187 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-09-28T13:19:00.188+0000 7f82f69e1700 0 -- 172.21.15.69:0/3280352328 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55782739a7b0 msgr2=0x55782748f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:00.191 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 100% complete...done. 2023-09-28T13:19:00.193 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:00.237 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:00.242 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:00.242 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 200.004 bytes/sec: 200 KiB/s 2023-09-28T13:19:00.252 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:19:00.348 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-09-28T13:19:00.349+0000 7f724b1c7700 0 -- 172.21.15.69:0/2338816588 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x562f669a8810 msgr2=0x562f669c9d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:00.355 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:00.358 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 2 test2 2023-09-28T13:19:00.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-09-28T13:19:00.531 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:00.530+0000 7f98ce6e6700 0 -- 172.21.15.69:0/9091707 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55c8918f62d0 msgr2=0x55c8918f75c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:00.536 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:00.586 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:00.593 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:00.594 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-09-28T13:19:00.602 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration execute test2 2023-09-28T13:19:00.695 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-09-28T13:19:00.695+0000 7f51f80b6700 0 -- 172.21.15.69:0/4206896025 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f51d4008740 msgr2=0x7f51d400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:00.731 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:00.730+0000 7f51f88b7700 0 -- 172.21.15.69:0/4206896025 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x559a0930af20 msgr2=0x559a093fc970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:00.731 INFO:tasks.workunit.client.0.smithi069.stderr: Image migration: 100% complete...done. 2023-09-28T13:19:00.734 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test2 2023-09-28T13:19:00.857 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-09-28T13:19:00.857+0000 7f5c721cd700 0 -- 172.21.15.69:0/3066730177 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x560e51adb050 msgr2=0x560e51bd49b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:00.863 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 100% complete...done. 2023-09-28T13:19:00.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:00.909 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:00.911 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:00.911 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-09-28T13:19:00.921 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:19:01.015 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-09-28T13:19:01.015+0000 7f5d70377700 0 -- 172.21.15.69:0/1796526979 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f5d5403abe0 msgr2=0x7f5d5403d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:01.028 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:01.031 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 2 test2 2023-09-28T13:19:01.074 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-09-28T13:19:01.147 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:01.146+0000 7f2ae7c4e500 -1 librbd::image::CreateRequest: 0x55a7aa355160 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-09-28T13:19:01.147 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:01.146+0000 7f2ae7c4e500 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-09-28T13:19:01.174 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-09-28T13:19:01.176 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:19:01.177 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:01.218 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:01.223 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:01.223 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-09-28T13:19:01.234 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:19:01.340 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-09-28T13:19:01.339+0000 7fb290097700 0 -- 172.21.15.69:0/1803014262 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fb274008740 msgr2=0x7fb27400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:01.348 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:01.351 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 2 test2 2023-09-28T13:19:01.396 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 rbd2/test2 2023-09-28T13:19:01.486 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:01.485+0000 7f07144b4700 0 -- 172.21.15.69:0/947845289 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x560d3c0d6fa0 msgr2=0x560d3c1c46d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:01.493 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-09-28T13:19:01.539 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:01.542 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:01.542 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-09-28T13:19:01.549 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test2 2023-09-28T13:19:01.671 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-09-28T13:19:01.674 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:01.716 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:01.718 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:01.718 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 500.011 bytes/sec: 500 KiB/s 2023-09-28T13:19:01.725 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:19:01.823 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-09-28T13:19:01.822+0000 7f64d6f18700 0 -- 172.21.15.69:0/2186758476 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55754bae1980 msgr2=0x55754bb88c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:01.829 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:01.832 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 2 test2 2023-09-28T13:19:01.876 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 rbd2/test2 2023-09-28T13:19:01.978 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:01.977+0000 7f90dfc53700 0 -- 172.21.15.69:0/2287912092 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55c2b3209fa0 msgr2=0x55c2b32f7bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:01.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort rbd2/test2 2023-09-28T13:19:02.087 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-09-28T13:19:02.086+0000 7fae01893700 0 -- 172.21.15.69:0/3216338534 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fade403abc0 msgr2=0x7fade403cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:02.089 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 100% complete...done. 2023-09-28T13:19:02.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:02.134 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:02.138 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:02.138 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-09-28T13:19:02.149 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:19:02.252 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-09-28T13:19:02.251+0000 7f4392942700 0 -- 172.21.15.69:0/1566558331 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f4370006490 msgr2=0x7f4370011e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:02.258 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:02.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ test 2 = 1 2023-09-28T13:19:02.261 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 128M --image-format 2 test2 2023-09-28T13:19:02.303 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2023-09-28T13:19:02.410 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:02.409+0000 7f370fdbf700 0 -- 172.21.15.69:0/3622269264 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x557468731fa0 msgr2=0x5574687d37b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:02.416 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2023-09-28T13:19:02.462 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:02.468 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:02.468 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 166.67 bytes/sec: 167 KiB/s 2023-09-28T13:19:02.476 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd migration abort test2 2023-09-28T13:19:02.579 INFO:tasks.workunit.client.0.smithi069.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-09-28T13:19:02.581 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-09-28T13:19:02.626 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-09-28T13:19:02.628 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:19:02.628 INFO:tasks.workunit.client.0.smithi069.stdout:elapsed: 0 ops: 1 ops/sec: 500.011 bytes/sec: 500 KiB/s 2023-09-28T13:19:02.639 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:19:02.732 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-09-28T13:19:02.731+0000 7f3a10d88700 0 -- 172.21.15.69:0/381982842 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f39f403abc0 msgr2=0x7f39f403cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:02.748 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:02.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:02.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:02.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:02.910 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:02.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.067 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.144 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.221 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.303 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.386 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.544 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.622 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.700 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.776 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.855 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:03.931 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:04.008 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:04.085 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:04.163 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-09-28T13:19:04.961 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'rbd2' does not exist 2023-09-28T13:19:04.970 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_config 2023-09-28T13:19:04.971 INFO:tasks.workunit.client.0.smithi069.stdout:testing config... 2023-09-28T13:19:04.971 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing config...' 2023-09-28T13:19:04.971 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:04.971 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.132 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.213 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.291 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.369 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.445 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.520 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.599 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.674 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.903 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:05.979 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:06.055 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:06.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:06.207 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:06.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:06.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config global set osd rbd_cache true 2023-09-28T13:19:06.368 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global set osd rbd_cache true 2023-09-28T13:19:06.390 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2023-09-28T13:19:06.391 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:06.391 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config global set global debug_ms 10 2023-09-28T13:19:06.392 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global set global debug_ms 10 2023-09-28T13:19:06.413 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: not rbd option: debug_ms 2023-09-28T13:19:06.415 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:06.415 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2023-09-28T13:19:06.415 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global set global rbd_UNKNOWN false 2023-09-28T13:19:06.437 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: invalid config key: rbd_UNKNOWN 2023-09-28T13:19:06.439 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:06.439 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2023-09-28T13:19:06.439 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global set global rbd_cache INVALID 2023-09-28T13:19:06.467 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2023-09-28T13:19:06.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:06.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global set global rbd_cache false 2023-09-28T13:19:06.503 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global set client rbd_cache true 2023-09-28T13:19:06.536 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global set client.123 rbd_cache false 2023-09-28T13:19:06.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global get global rbd_cache 2023-09-28T13:19:06.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^false$' 2023-09-28T13:19:06.596 INFO:tasks.workunit.client.0.smithi069.stdout:false 2023-09-28T13:19:06.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global get client rbd_cache 2023-09-28T13:19:06.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^true$' 2023-09-28T13:19:06.625 INFO:tasks.workunit.client.0.smithi069.stdout:true 2023-09-28T13:19:06.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global get client.123 rbd_cache 2023-09-28T13:19:06.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^false$' 2023-09-28T13:19:06.654 INFO:tasks.workunit.client.0.smithi069.stdout:false 2023-09-28T13:19:06.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2023-09-28T13:19:06.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2023-09-28T13:19:06.681 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: rbd_cache is not set 2023-09-28T13:19:06.684 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:06.684 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global list global 2023-09-28T13:19:06.684 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * false * global *$' 2023-09-28T13:19:06.711 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache false global 2023-09-28T13:19:06.711 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global list client 2023-09-28T13:19:06.712 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * true * client *$' 2023-09-28T13:19:06.740 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache true client 2023-09-28T13:19:06.740 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global list client.123 2023-09-28T13:19:06.740 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * false * client.123 *$' 2023-09-28T13:19:06.768 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache false client.123 2023-09-28T13:19:06.768 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global list client.UNKNOWN 2023-09-28T13:19:06.768 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * true * client *$' 2023-09-28T13:19:06.796 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache true client 2023-09-28T13:19:06.796 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global rm client rbd_cache 2023-09-28T13:19:06.829 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config global get client rbd_cache 2023-09-28T13:19:06.829 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global get client rbd_cache 2023-09-28T13:19:06.855 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: rbd_cache is not set 2023-09-28T13:19:06.858 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:06.858 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global list client 2023-09-28T13:19:06.858 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * false * global *$' 2023-09-28T13:19:06.885 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache false global 2023-09-28T13:19:06.886 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global rm client.123 rbd_cache 2023-09-28T13:19:06.917 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config global rm global rbd_cache 2023-09-28T13:19:06.949 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config pool set rbd rbd_cache true 2023-09-28T13:19:06.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config pool list rbd 2023-09-28T13:19:06.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * true * pool *$' 2023-09-28T13:19:07.020 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache true pool 2023-09-28T13:19:07.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config pool get rbd rbd_cache 2023-09-28T13:19:07.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^true$' 2023-09-28T13:19:07.049 INFO:tasks.workunit.client.0.smithi069.stdout:true 2023-09-28T13:19:07.049 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 1 test1 2023-09-28T13:19:07.076 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:07.075+0000 7fc285111500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:07.084 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config image list rbd/test1 2023-09-28T13:19:07.084 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * true * pool *$' 2023-09-28T13:19:07.124 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache true pool 2023-09-28T13:19:07.124 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config image set rbd/test1 rbd_cache false 2023-09-28T13:19:07.167 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config image list rbd/test1 2023-09-28T13:19:07.167 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * false * image *$' 2023-09-28T13:19:07.205 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache false image 2023-09-28T13:19:07.205 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-09-28T13:19:07.205 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^false$' 2023-09-28T13:19:07.444 INFO:tasks.workunit.client.0.smithi069.stdout:false 2023-09-28T13:19:07.444 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config image remove rbd/test1 rbd_cache 2023-09-28T13:19:07.485 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2023-09-28T13:19:07.485 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-09-28T13:19:07.518 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: rbd_cache is not set 2023-09-28T13:19:07.522 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:07.522 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config image list rbd/test1 2023-09-28T13:19:07.523 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * true * pool *$' 2023-09-28T13:19:07.559 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache true pool 2023-09-28T13:19:07.560 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config pool remove rbd rbd_cache 2023-09-28T13:19:07.596 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2023-09-28T13:19:07.596 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config pool get rbd rbd_cache 2023-09-28T13:19:07.624 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: rbd_cache is not set 2023-09-28T13:19:07.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:19:07.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd config pool list rbd 2023-09-28T13:19:07.627 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^rbd_cache * true * config *$' 2023-09-28T13:19:07.655 INFO:tasks.workunit.client.0.smithi069.stdout:rbd_cache true config 2023-09-28T13:19:07.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:19:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:07.698 INFO:tasks.workunit.client.0.smithi069.stderr:+ RBD_CREATE_ARGS= 2023-09-28T13:19:07.699 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_others 2023-09-28T13:19:07.699 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-09-28T13:19:07.699 INFO:tasks.workunit.client.0.smithi069.stdout:testing import, export, resize, and snapshots... 2023-09-28T13:19:07.700 INFO:tasks.workunit.client.0.smithi069.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-09-28T13:19:07.700 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:07.700 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:07.776 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:07.853 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:07.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.004 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.283 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.357 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.433 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.511 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.588 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.666 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.742 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.818 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.898 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:08.976 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:09.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:09.330 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:09.409 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:09.485 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-09-28T13:19:09.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-09-28T13:19:09.487 INFO:tasks.workunit.client.0.smithi069.stderr:1+0 records in 2023-09-28T13:19:09.487 INFO:tasks.workunit.client.0.smithi069.stderr:1+0 records out 2023-09-28T13:19:09.487 INFO:tasks.workunit.client.0.smithi069.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.0582e-05 s, 25.2 MB/s 2023-09-28T13:19:09.487 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-09-28T13:19:09.488 INFO:tasks.workunit.client.0.smithi069.stderr:10+0 records in 2023-09-28T13:19:09.488 INFO:tasks.workunit.client.0.smithi069.stderr:10+0 records out 2023-09-28T13:19:09.488 INFO:tasks.workunit.client.0.smithi069.stderr:10240 bytes (10 kB, 10 KiB) copied, 5.0241e-05 s, 204 MB/s 2023-09-28T13:19:09.488 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-09-28T13:19:09.489 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records in 2023-09-28T13:19:09.489 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records out 2023-09-28T13:19:09.489 INFO:tasks.workunit.client.0.smithi069.stderr:72216 bytes (72 kB, 71 KiB) copied, 0.00017559 s, 411 MB/s 2023-09-28T13:19:09.489 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-09-28T13:19:09.490 INFO:tasks.workunit.client.0.smithi069.stderr:140+1 records in 2023-09-28T13:19:09.490 INFO:tasks.workunit.client.0.smithi069.stderr:140+1 records out 2023-09-28T13:19:09.490 INFO:tasks.workunit.client.0.smithi069.stderr:143368 bytes (143 kB, 140 KiB) copied, 0.000323829 s, 443 MB/s 2023-09-28T13:19:09.490 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-09-28T13:19:09.490 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records in 2023-09-28T13:19:09.491 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records out 2023-09-28T13:19:09.491 INFO:tasks.workunit.client.0.smithi069.stderr:72320 bytes (72 kB, 71 KiB) copied, 0.000196621 s, 368 MB/s 2023-09-28T13:19:09.491 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import /tmp/img1 testimg1 2023-09-28T13:19:09.517 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:09.516+0000 7f90ab4c9500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:09.592 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-09-28T13:19:09.595 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-09-28T13:19:09.636 INFO:tasks.workunit.client.0.smithi069.stderr: Resizing image: 100% complete...done. 2023-09-28T13:19:09.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img2 2023-09-28T13:19:09.740 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:09.743 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1 --snap=snap1 2023-09-28T13:19:10.604 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:19:10.608 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd resize testimg1 --size=128 2023-09-28T13:19:10.642 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-09-28T13:19:10.646 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:19:10.646 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-09-28T13:19:10.695 INFO:tasks.workunit.client.0.smithi069.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-09-28T13:19:10.699 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img3 2023-09-28T13:19:10.769 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:10.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg1 2023-09-28T13:19:10.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:10.804 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:10.804 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg1 2023-09-28T13:19:10.805 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:10.837 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:10.837 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-09-28T13:19:10.838 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-09-28T13:19:10.935 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:10.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-09-28T13:19:10.991 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:19:10.995 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --size=1 testimg-diff1 2023-09-28T13:19:11.025 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:11.024+0000 7f25ea86e500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:11.033 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-09-28T13:19:11.608 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-09-28T13:19:11.613 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-09-28T13:19:11.666 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-09-28T13:19:11.670 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg1 2023-09-28T13:19:11.671 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:11.703 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:11.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg1 2023-09-28T13:19:11.703 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:11.735 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:11.736 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff1 2023-09-28T13:19:11.736 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:11.767 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:11.767 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-09-28T13:19:11.767 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:11.799 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:11.800 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-09-28T13:19:11.885 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:11.888 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg1 testimg3 2023-09-28T13:19:11.966 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:11.970 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-09-28T13:19:12.066 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:12.069 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-09-28T13:19:12.152 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:12.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg2 2023-09-28T13:19:12.157 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:12.189 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:12.190 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg3 2023-09-28T13:19:12.190 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:12.223 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:12.224 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff2 2023-09-28T13:19:12.224 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:12.256 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:12.257 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff3 2023-09-28T13:19:12.257 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:12.290 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:12.290 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep copy testimg1 testimg4 2023-09-28T13:19:12.777 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete...2023-09-28T13:19:12.775+0000 7f39fefbd700 0 -- 172.21.15.69:0/2446327805 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f39e0001be0 msgr2=0x7f39e0004090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:12.780 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 100% complete...done. 2023-09-28T13:19:12.787 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-09-28T13:19:13.775 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-09-28T13:19:13.778 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg4 2023-09-28T13:19:13.778 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:13.813 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:13.814 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg5 2023-09-28T13:19:13.814 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:13.848 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:13.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg4 2023-09-28T13:19:13.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:19:13.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:13.849 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:19:13.883 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:19:13.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg4 2023-09-28T13:19:13.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '.*snap1.*' 2023-09-28T13:19:13.918 INFO:tasks.workunit.client.0.smithi069.stdout: 19 snap1 256 MiB Thu Sep 28 13:19:12 2023 2023-09-28T13:19:13.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img1.new 2023-09-28T13:19:13.981 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:13.984 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg2 /tmp/img2.new 2023-09-28T13:19:14.078 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:14.082 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg3 /tmp/img3.new 2023-09-28T13:19:14.156 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:14.159 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-09-28T13:19:14.223 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:14.226 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-09-28T13:19:14.327 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:14.330 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-09-28T13:19:14.401 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:14.404 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-09-28T13:19:14.599 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-09-28T13:19:14.693 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-09-28T13:19:14.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-09-28T13:19:14.929 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-09-28T13:19:15.026 INFO:tasks.workunit.client.0.smithi069.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-09-28T13:19:15.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-09-28T13:19:15.128 INFO:tasks.workunit.client.0.smithi069.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-09-28T13:19:15.135 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg1 2023-09-28T13:19:15.136 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:15.168 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:15.168 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff1 2023-09-28T13:19:15.168 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:15.400 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:15.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-09-28T13:19:15.497 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:15.500 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-09-28T13:19:15.604 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:15.607 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-09-28T13:19:15.758 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-09-28T13:19:15.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm testimg2 2023-09-28T13:19:16.025 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete...2023-09-28T13:19:16.024+0000 7fe152c12700 0 -- 172.21.15.69:0/1464158822 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x5621b2abf640 msgr2=0x5621b2aab700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:16.041 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-09-28T13:19:16.041+0000 7fe152c12700 0 -- 172.21.15.69:0/1464158822 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fe13803a360 msgr2=0x7fe13803c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:16.042 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:16.044 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm testimg3 2023-09-28T13:19:16.140 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-09-28T13:19:16.143 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create testimg2 -s 0 2023-09-28T13:19:16.170 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:16.170+0000 7ff370674500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:16.177 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd cp testimg2 testimg3 2023-09-28T13:19:16.228 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 100% complete...done. 2023-09-28T13:19:16.231 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep cp testimg2 testimg6 2023-09-28T13:19:16.288 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 100% complete...done. 2023-09-28T13:19:16.290 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-09-28T13:19:16.740 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:19:16.747 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-09-28T13:19:17.741 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:19:17.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg1 2023-09-28T13:19:17.750 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-09-28T13:19:17.786 INFO:tasks.workunit.client.0.smithi069.stdout:error setting snapshot context: (2) No such file or directory 2023-09-28T13:19:17.787 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-09-28T13:19:17.787 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-09-28T13:19:17.819 INFO:tasks.workunit.client.0.smithi069.stdout:error setting snapshot context: (2) No such file or directory 2023-09-28T13:19:17.819 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd sparsify testimg1 2023-09-28T13:19:17.911 INFO:tasks.workunit.client.0.smithi069.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-09-28T13:19:17.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:17.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:18.039 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:18.322 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:18.440 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:18.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:19.878 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.001 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.108 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.279 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.429 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.509 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.591 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.670 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.749 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.828 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:20.994 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.152 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-09-28T13:19:21.267 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_locking 2023-09-28T13:19:21.268 INFO:tasks.workunit.client.0.smithi069.stdout:testing locking... 2023-09-28T13:19:21.268 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing locking...' 2023-09-28T13:19:21.268 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:21.268 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.345 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.421 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.502 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.581 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.860 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:21.935 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.012 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.291 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.370 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.449 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.525 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.602 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.680 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.757 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.833 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.911 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:22.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:23.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create -s 1 test1 2023-09-28T13:19:23.093 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:23.092+0000 7f659d9e5500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:23.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:23.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:23.102 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:19:23.133 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:19:23.134 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id 2023-09-28T13:19:23.172 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:23.173 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 1 ' 2023-09-28T13:19:23.204 INFO:tasks.workunit.client.0.smithi069.stdout:There is 1 exclusive lock on this image. 2023-09-28T13:19:23.204 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd lock list test1 2023-09-28T13:19:23.204 INFO:tasks.workunit.client.0.smithi069.stderr:++ tail -n 1 2023-09-28T13:19:23.205 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1;}' 2023-09-28T13:19:23.236 INFO:tasks.workunit.client.0.smithi069.stderr:+ LOCKER=client.7786 2023-09-28T13:19:23.236 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock remove test1 id client.7786 2023-09-28T13:19:23.761 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:23.761 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:23.762 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:19:23.792 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:19:23.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id --shared tag 2023-09-28T13:19:23.833 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:23.833 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 1 ' 2023-09-28T13:19:23.864 INFO:tasks.workunit.client.0.smithi069.stdout:There is 1 shared lock on this image. 2023-09-28T13:19:23.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id --shared tag 2023-09-28T13:19:23.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:23.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 2 ' 2023-09-28T13:19:23.936 INFO:tasks.workunit.client.0.smithi069.stdout:There are 2 shared locks on this image. 2023-09-28T13:19:23.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id2 --shared tag 2023-09-28T13:19:23.979 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:23.979 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 3 ' 2023-09-28T13:19:24.010 INFO:tasks.workunit.client.0.smithi069.stdout:There are 3 shared locks on this image. 2023-09-28T13:19:24.011 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:24.011 INFO:tasks.workunit.client.0.smithi069.stderr:+ tail -n 1 2023-09-28T13:19:24.011 INFO:tasks.workunit.client.0.smithi069.stderr:+ awk '{print $2, $1;}' 2023-09-28T13:19:24.011 INFO:tasks.workunit.client.0.smithi069.stderr:+ xargs rbd lock remove test1 2023-09-28T13:19:24.763 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info test1 2023-09-28T13:19:24.763 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -qE 'features:.*exclusive' 2023-09-28T13:19:24.800 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:19:24.843 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:24.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_thick_provision 2023-09-28T13:19:24.846 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing thick provision...' 2023-09-28T13:19:24.846 INFO:tasks.workunit.client.0.smithi069.stdout:testing thick provision... 2023-09-28T13:19:24.847 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:24.847 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:24.925 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.002 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.156 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.233 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.587 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.664 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.741 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.820 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.896 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:25.974 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:26.053 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:26.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:26.409 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:26.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:26.565 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:26.643 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --thick-provision -s 64M test1 2023-09-28T13:19:26.670 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:26.670+0000 7f3ad0f9c500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:26.916 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-09-28T13:19:26.924 INFO:tasks.workunit.client.0.smithi069.stderr:+ count=0 2023-09-28T13:19:26.924 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret= 2023-09-28T13:19:26.924 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 -lt 10 ']' 2023-09-28T13:19:26.924 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:19:26.925 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:19:26.925 INFO:tasks.workunit.client.0.smithi069.stderr:+ tr -s ' ' 2023-09-28T13:19:26.925 INFO:tasks.workunit.client.0.smithi069.stderr:+ cut -d ' ' -f 4-5 2023-09-28T13:19:26.925 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^64 MiB' 2023-09-28T13:19:27.148 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:27.148+0000 7f5f9b802700 0 --2- 172.21.15.69:0/1601170838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d918461b0 0x555d918e4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:19:27.155 INFO:tasks.workunit.client.0.smithi069.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-09-28T13:19:27.159 INFO:tasks.workunit.client.0.smithi069.stdout:64 MiB 2023-09-28T13:19:27.160 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret=0 2023-09-28T13:19:27.160 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 = 0 ']' 2023-09-28T13:19:27.160 INFO:tasks.workunit.client.0.smithi069.stderr:+ break 2023-09-28T13:19:27.160 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:19:27.188 INFO:tasks.workunit.client.0.smithi069.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-09-28T13:19:27.189 INFO:tasks.workunit.client.0.smithi069.stdout:NAME PROVISIONED USED 2023-09-28T13:19:27.189 INFO:tasks.workunit.client.0.smithi069.stdout:test1 64 MiB 64 MiB 2023-09-28T13:19:27.192 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 '!=' 0 ']' 2023-09-28T13:19:27.192 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:19:27.258 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2023-09-28T13:19:27.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:19:27.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:19:27.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:27.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:19:27.487 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:27.486+0000 7f0315665700 0 --2- 172.21.15.69:0/1352392898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563640da5d50 0x563640e3bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:19:27.492 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:19:27.492 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --thick-provision -s 4G test1 2023-09-28T13:19:27.520 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:27.520+0000 7f84ca4d8500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:28.436 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete...2023-09-28T13:19:28.435+0000 7f84c1fea700 0 -- 172.21.15.69:0/2787338658 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55c4a0f0a170 msgr2=0x55c4a0f0c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:28.654 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 12% complete... Thick provisioning: 13% complete...2023-09-28T13:19:28.654+0000 7f84c27eb700 0 -- 172.21.15.69:0/2787338658 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55c4a0e69380 msgr2=0x55c4a0e5c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:28.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:19:28.656+0000 7f96ea87f700 -1 reset not still connected to 0x56355ca14270 2023-09-28T13:19:36.921 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-09-28T13:19:36.926 INFO:tasks.workunit.client.0.smithi069.stderr:+ count=0 2023-09-28T13:19:36.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret= 2023-09-28T13:19:36.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 -lt 10 ']' 2023-09-28T13:19:36.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:19:36.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:19:36.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ tr -s ' ' 2023-09-28T13:19:36.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ cut -d ' ' -f 4-5 2023-09-28T13:19:36.927 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^4 GiB' 2023-09-28T13:19:36.955 INFO:tasks.workunit.client.0.smithi069.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-09-28T13:19:37.005 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:37.004+0000 7fb92bdf5700 0 -- 172.21.15.69:0/3931833048 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x555e7e3f1ee0 msgr2=0x555e7e3f42c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:37.007 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:37.007+0000 7fb92c5f6700 0 -- 172.21.15.69:0/3931833048 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x555e7e346aa0 msgr2=0x555e7e3ea310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:19:37.125 INFO:tasks.workunit.client.0.smithi069.stdout:4 GiB 2023-09-28T13:19:37.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret=0 2023-09-28T13:19:37.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 = 0 ']' 2023-09-28T13:19:37.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ break 2023-09-28T13:19:37.126 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:19:37.153 INFO:tasks.workunit.client.0.smithi069.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-09-28T13:19:37.165 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:37.164+0000 7fadbef88700 0 -- 172.21.15.69:0/3096841198 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55f152944aa0 msgr2=0x55f1529e9250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:37.167 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:37.167+0000 7fadbef88700 0 -- 172.21.15.69:0/3096841198 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fada003a390 msgr2=0x7fada003c7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:37.282 INFO:tasks.workunit.client.0.smithi069.stdout:NAME PROVISIONED USED 2023-09-28T13:19:37.282 INFO:tasks.workunit.client.0.smithi069.stdout:test1 4 GiB 4 GiB 2023-09-28T13:19:37.284 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 '!=' 0 ']' 2023-09-28T13:19:37.284 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:19:37.408 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete...2023-09-28T13:19:37.407+0000 7fdb21c52700 0 -- 172.21.15.69:0/1210706123 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55d20c9d9310 msgr2=0x55d20c9eace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:19:37.426 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 11% complete... Removing image: 12% complete...2023-09-28T13:19:37.425+0000 7fdb21c52700 0 -- 172.21.15.69:0/1210706123 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fdb0403a460 msgr2=0x7fdb0403c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:38.229 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-09-28T13:19:38.233 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:19:38.233 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:19:38.233 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:38.233 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:19:38.259 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:19:38.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2023-09-28T13:19:38.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_others 2023-09-28T13:19:38.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-09-28T13:19:38.260 INFO:tasks.workunit.client.0.smithi069.stdout:testing import, export, resize, and snapshots... 2023-09-28T13:19:38.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-09-28T13:19:38.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:38.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:38.339 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:38.417 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:38.497 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:38.776 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:38.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:38.931 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.009 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.087 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.165 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.243 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.321 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.399 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.478 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.556 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.836 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.914 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:39.992 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:40.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-09-28T13:19:40.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-09-28T13:19:40.072 INFO:tasks.workunit.client.0.smithi069.stderr:1+0 records in 2023-09-28T13:19:40.072 INFO:tasks.workunit.client.0.smithi069.stderr:1+0 records out 2023-09-28T13:19:40.072 INFO:tasks.workunit.client.0.smithi069.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.1995e-05 s, 24.4 MB/s 2023-09-28T13:19:40.072 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-09-28T13:19:40.073 INFO:tasks.workunit.client.0.smithi069.stderr:10+0 records in 2023-09-28T13:19:40.073 INFO:tasks.workunit.client.0.smithi069.stderr:10+0 records out 2023-09-28T13:19:40.073 INFO:tasks.workunit.client.0.smithi069.stderr:10240 bytes (10 kB, 10 KiB) copied, 5.18e-05 s, 198 MB/s 2023-09-28T13:19:40.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-09-28T13:19:40.073 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records in 2023-09-28T13:19:40.074 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records out 2023-09-28T13:19:40.074 INFO:tasks.workunit.client.0.smithi069.stderr:72216 bytes (72 kB, 71 KiB) copied, 0.000189358 s, 381 MB/s 2023-09-28T13:19:40.074 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-09-28T13:19:40.074 INFO:tasks.workunit.client.0.smithi069.stderr:140+1 records in 2023-09-28T13:19:40.075 INFO:tasks.workunit.client.0.smithi069.stderr:140+1 records out 2023-09-28T13:19:40.075 INFO:tasks.workunit.client.0.smithi069.stderr:143368 bytes (143 kB, 140 KiB) copied, 0.000331171 s, 433 MB/s 2023-09-28T13:19:40.075 INFO:tasks.workunit.client.0.smithi069.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-09-28T13:19:40.075 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records in 2023-09-28T13:19:40.076 INFO:tasks.workunit.client.0.smithi069.stderr:70+1 records out 2023-09-28T13:19:40.076 INFO:tasks.workunit.client.0.smithi069.stderr:72320 bytes (72 kB, 71 KiB) copied, 0.000178971 s, 404 MB/s 2023-09-28T13:19:40.076 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2023-09-28T13:19:40.198 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-09-28T13:19:40.201 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-09-28T13:19:40.250 INFO:tasks.workunit.client.0.smithi069.stderr: Resizing image: 100% complete...done. 2023-09-28T13:19:40.259 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img2 2023-09-28T13:19:40.361 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:40.364 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1 --snap=snap1 2023-09-28T13:19:40.907 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:19:40.915 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd resize testimg1 --size=128 2023-09-28T13:19:40.950 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-09-28T13:19:40.954 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:19:40.954 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-09-28T13:19:40.998 INFO:tasks.workunit.client.0.smithi069.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-09-28T13:19:41.006 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img3 2023-09-28T13:19:41.079 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:41.082 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg1 2023-09-28T13:19:41.082 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:41.116 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:41.117 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg1 2023-09-28T13:19:41.117 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:41.153 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:41.153 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-09-28T13:19:41.154 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-09-28T13:19:41.207 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:41.210 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-09-28T13:19:41.256 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 100% complete...done. 2023-09-28T13:19:41.260 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2023-09-28T13:19:41.303 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-09-28T13:19:41.911 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-09-28T13:19:41.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-09-28T13:19:41.964 INFO:tasks.workunit.client.0.smithi069.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-09-28T13:19:41.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg1 2023-09-28T13:19:41.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:42.006 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:42.007 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg1 2023-09-28T13:19:42.007 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:42.044 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:42.045 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff1 2023-09-28T13:19:42.045 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:42.078 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:42.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-09-28T13:19:42.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:42.115 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:42.115 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-09-28T13:19:42.233 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:42.236 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg1 testimg3 2023-09-28T13:19:42.344 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:42.347 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-09-28T13:19:42.444 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:42.447 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-09-28T13:19:42.555 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-09-28T13:19:42.558 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg2 2023-09-28T13:19:42.559 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:42.593 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:42.594 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg3 2023-09-28T13:19:42.594 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:42.626 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:42.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff2 2023-09-28T13:19:42.626 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:42.659 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:42.660 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff3 2023-09-28T13:19:42.660 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:42.693 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:42.693 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep copy testimg1 testimg4 2023-09-28T13:19:42.952 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-09-28T13:19:42.955 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-09-28T13:19:43.963 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-09-28T13:19:43.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg4 2023-09-28T13:19:43.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 128 MiB' 2023-09-28T13:19:44.001 INFO:tasks.workunit.client.0.smithi069.stdout: size 128 MiB in 32 objects 2023-09-28T13:19:44.002 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg5 2023-09-28T13:19:44.002 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:44.035 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:44.036 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg4 2023-09-28T13:19:44.037 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:19:44.037 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:44.037 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:19:44.075 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:19:44.075 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg4 2023-09-28T13:19:44.075 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '.*snap1.*' 2023-09-28T13:19:44.109 INFO:tasks.workunit.client.0.smithi069.stdout: 27 snap1 256 MiB Thu Sep 28 13:19:42 2023 2023-09-28T13:19:44.109 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img1.new 2023-09-28T13:19:44.183 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:44.186 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg2 /tmp/img2.new 2023-09-28T13:19:44.287 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:44.290 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg3 /tmp/img3.new 2023-09-28T13:19:44.360 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:44.364 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-09-28T13:19:44.440 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:44.443 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-09-28T13:19:44.541 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:44.544 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-09-28T13:19:44.626 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:44.629 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-09-28T13:19:44.823 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-09-28T13:19:44.920 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-09-28T13:19:45.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-09-28T13:19:45.158 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-09-28T13:19:45.255 INFO:tasks.workunit.client.0.smithi069.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-09-28T13:19:45.267 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-09-28T13:19:45.377 INFO:tasks.workunit.client.0.smithi069.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-09-28T13:19:45.389 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg1 2023-09-28T13:19:45.389 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:45.423 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:45.424 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg-diff1 2023-09-28T13:19:45.424 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:19:45.457 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:19:45.457 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-09-28T13:19:45.561 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:45.564 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-09-28T13:19:45.658 INFO:tasks.workunit.client.0.smithi069.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-09-28T13:19:45.661 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-09-28T13:19:45.808 INFO:tasks.workunit.client.0.smithi069.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-09-28T13:19:45.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm testimg2 2023-09-28T13:19:46.058 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-09-28T13:19:46.059+0000 7fa2aeed0700 0 -- 172.21.15.69:0/1451392352 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fa28c008740 msgr2=0x7fa28c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:19:46.069 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:46.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm testimg3 2023-09-28T13:19:46.174 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-09-28T13:19:46.174+0000 7f53da5e0700 0 -- 172.21.15.69:0/439886547 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f53c0008740 msgr2=0x7f53c000abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:46.186 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:46.188 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create testimg2 -s 0 2023-09-28T13:19:46.216 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:46.216+0000 7ff120e1a500 -1 librbd: Forced V1 image creation. 2023-09-28T13:19:46.223 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd cp testimg2 testimg3 2023-09-28T13:19:46.289 INFO:tasks.workunit.client.0.smithi069.stderr: Image copy: 100% complete...done. 2023-09-28T13:19:46.291 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep cp testimg2 testimg6 2023-09-28T13:19:46.342 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 100% complete...done. 2023-09-28T13:19:46.345 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-09-28T13:19:46.918 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:19:46.930 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-09-28T13:19:47.922 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:19:47.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg1 2023-09-28T13:19:47.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-09-28T13:19:47.971 INFO:tasks.workunit.client.0.smithi069.stdout:error setting snapshot context: (2) No such file or directory 2023-09-28T13:19:47.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-09-28T13:19:47.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-09-28T13:19:48.005 INFO:tasks.workunit.client.0.smithi069.stdout:error setting snapshot context: (2) No such file or directory 2023-09-28T13:19:48.006 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd sparsify testimg1 2023-09-28T13:19:48.075 INFO:tasks.workunit.client.0.smithi069.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-09-28T13:19:48.085 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:48.085 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:48.250 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:48.328 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:48.464 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:49.068 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:50.263 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:50.382 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:50.550 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:50.722 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:50.894 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:50.984 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.066 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.145 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.224 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.303 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.385 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.753 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:51.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-09-28T13:19:51.950 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_locking 2023-09-28T13:19:51.951 INFO:tasks.workunit.client.0.smithi069.stdout:testing locking... 2023-09-28T13:19:51.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing locking...' 2023-09-28T13:19:51.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:51.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.031 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.109 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.189 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.268 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.349 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.432 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.511 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.591 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.673 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.751 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.830 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.909 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:52.989 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:53.069 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:53.148 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:53.228 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:53.308 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:53.389 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test1 2023-09-28T13:19:53.436 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:53.436 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:53.436 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:19:53.472 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:19:53.472 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id 2023-09-28T13:19:53.518 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:53.518 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 1 ' 2023-09-28T13:19:53.553 INFO:tasks.workunit.client.0.smithi069.stdout:There is 1 exclusive lock on this image. 2023-09-28T13:19:53.553 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd lock list test1 2023-09-28T13:19:53.553 INFO:tasks.workunit.client.0.smithi069.stderr:++ tail -n 1 2023-09-28T13:19:53.554 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{print $1;}' 2023-09-28T13:19:53.587 INFO:tasks.workunit.client.0.smithi069.stderr:+ LOCKER=client.8461 2023-09-28T13:19:53.587 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock remove test1 id client.8461 2023-09-28T13:19:53.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:53.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:19:53.941 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:19:53.976 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:19:53.977 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id --shared tag 2023-09-28T13:19:54.019 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:54.019 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 1 ' 2023-09-28T13:19:54.053 INFO:tasks.workunit.client.0.smithi069.stdout:There is 1 shared lock on this image. 2023-09-28T13:19:54.053 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id --shared tag 2023-09-28T13:19:54.096 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:54.096 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 2 ' 2023-09-28T13:19:54.129 INFO:tasks.workunit.client.0.smithi069.stdout:There are 2 shared locks on this image. 2023-09-28T13:19:54.130 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock add test1 id2 --shared tag 2023-09-28T13:19:54.174 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:54.174 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep ' 3 ' 2023-09-28T13:19:54.207 INFO:tasks.workunit.client.0.smithi069.stdout:There are 3 shared locks on this image. 2023-09-28T13:19:54.208 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:54.208 INFO:tasks.workunit.client.0.smithi069.stderr:+ tail -n 1 2023-09-28T13:19:54.208 INFO:tasks.workunit.client.0.smithi069.stderr:+ awk '{print $2, $1;}' 2023-09-28T13:19:54.208 INFO:tasks.workunit.client.0.smithi069.stderr:+ xargs rbd lock remove test1 2023-09-28T13:19:54.945 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info test1 2023-09-28T13:19:54.945 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -qE 'features:.*exclusive' 2023-09-28T13:19:54.978 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd lock list test1 2023-09-28T13:19:55.012 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' -n 'There are 2 shared locks on this image. 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:Lock tag: tag 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:Locker ID Address 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:client.8476 id 172.21.15.69:0/3187364321 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:client.8482 id 172.21.15.69:0/1955911118' ']' 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ tail -n 1 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ awk '{print $2, $1;}' 2023-09-28T13:19:55.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ xargs rbd lock remove test1 2023-09-28T13:19:55.948 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd lock list test1 2023-09-28T13:19:55.985 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' -n 'There is 1 shared lock on this image. 2023-09-28T13:19:55.985 INFO:tasks.workunit.client.0.smithi069.stderr:Lock tag: tag 2023-09-28T13:19:55.986 INFO:tasks.workunit.client.0.smithi069.stderr:Locker ID Address 2023-09-28T13:19:55.986 INFO:tasks.workunit.client.0.smithi069.stderr:client.8476 id 172.21.15.69:0/3187364321' ']' 2023-09-28T13:19:55.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd lock list test1 2023-09-28T13:19:55.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ tail -n 1 2023-09-28T13:19:55.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ awk '{print $2, $1;}' 2023-09-28T13:19:55.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ xargs rbd lock remove test1 2023-09-28T13:19:56.750 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd lock list test1 2023-09-28T13:19:56.787 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' -n '' ']' 2023-09-28T13:19:56.788 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:19:56.914 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:19:56.913+0000 7f6141921700 0 -- 172.21.15.69:0/1622279005 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55812049f370 msgr2=0x5581204a0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:19:56.915 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:19:56.917 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_clone 2023-09-28T13:19:56.917 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing clone...' 2023-09-28T13:19:56.918 INFO:tasks.workunit.client.0.smithi069.stdout:testing clone... 2023-09-28T13:19:56.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:19:56.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.000 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.080 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.158 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.237 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.518 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.596 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.676 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.754 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.834 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.913 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:57.992 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:58.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:58.150 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:58.229 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:58.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:58.387 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:58.466 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:19:58.546 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create test1 --image-format 2 -s 1 2023-09-28T13:19:58.591 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@s1 2023-09-28T13:19:58.962 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:19:58.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect test1@s1 2023-09-28T13:19:59.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool create rbd2 8 2023-09-28T13:20:00.072 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'rbd2' already exists 2023-09-28T13:20:00.081 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd pool init rbd2 2023-09-28T13:20:02.977 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone test1@s1 rbd2/clone 2023-09-28T13:20:03.042 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd -p rbd2 ls 2023-09-28T13:20:03.042 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep clone 2023-09-28T13:20:03.265 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:03.264+0000 7ffb96073700 0 --2- 172.21.15.69:0/1370564509 >> v2:172.21.15.69:3300/0 conn(0x55ce78ab36b0 0x55ce78ab3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:20:03.274 INFO:tasks.workunit.client.0.smithi069.stdout:clone 2023-09-28T13:20:03.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep clone 2023-09-28T13:20:03.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd -p rbd2 ls -l 2023-09-28T13:20:03.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1@s1 2023-09-28T13:20:03.324 INFO:tasks.workunit.client.0.smithi069.stdout:clone 1 MiB rbd/test1@s1 2 2023-09-28T13:20:03.324 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:03.325 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v clone 2023-09-28T13:20:03.353 INFO:tasks.workunit.client.0.smithi069.stdout:test1 2023-09-28T13:20:03.354 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd flatten rbd2/clone 2023-09-28T13:20:03.399 INFO:tasks.workunit.client.0.smithi069.stderr: Image flatten: 100% complete...done. 2023-09-28T13:20:03.406 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create rbd2/clone@s1 2023-09-28T13:20:03.975 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:03.983 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect rbd2/clone@s1 2023-09-28T13:20:04.027 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone rbd2/clone@s1 clone2 2023-09-28T13:20:04.097 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:04.097 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep clone2 2023-09-28T13:20:04.122 INFO:tasks.workunit.client.0.smithi069.stdout:clone2 2023-09-28T13:20:04.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:20:04.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep clone2 2023-09-28T13:20:04.123 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep rbd2/clone@s1 2023-09-28T13:20:04.164 INFO:tasks.workunit.client.0.smithi069.stdout:clone2 1 MiB rbd2/clone@s1 2 2023-09-28T13:20:04.164 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd -p rbd2 ls 2023-09-28T13:20:04.165 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v clone2 2023-09-28T13:20:04.193 INFO:tasks.workunit.client.0.smithi069.stdout:clone 2023-09-28T13:20:04.193 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm clone2 2023-09-28T13:20:04.306 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:04.305+0000 7f114ebb8700 0 -- 172.21.15.69:0/2294030884 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f112c008740 msgr2=0x7f112c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:20:04.306 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:04.309 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect rbd2/clone@s1 2023-09-28T13:20:04.350 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm rbd2/clone@s1 2023-09-28T13:20:04.974 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:04.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm rbd2/clone 2023-09-28T13:20:05.078 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:05.077+0000 7fe498941700 0 -- 172.21.15.69:0/4258042053 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fe474008740 msgr2=0x7fe47400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:20:05.083 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:05.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect test1@s1 2023-09-28T13:20:05.131 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm test1@s1 2023-09-28T13:20:05.979 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:05.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:20:06.115 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:06.114+0000 7f647b8fb700 0 -- 172.21.15.69:0/2549272621 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x5624c80e0d20 msgr2=0x5624c80cc470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:20:06.116 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:06.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-09-28T13:20:07.110 INFO:tasks.workunit.client.0.smithi069.stderr:pool 'rbd2' does not exist 2023-09-28T13:20:07.120 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_trash 2023-09-28T13:20:07.120 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing trash...' 2023-09-28T13:20:07.120 INFO:tasks.workunit.client.0.smithi069.stdout:testing trash... 2023-09-28T13:20:07.121 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:20:07.121 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.403 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.483 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.562 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.720 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.802 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:07.964 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.044 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.125 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.404 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.484 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.564 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.645 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.725 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.805 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.885 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:08.965 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test1 2023-09-28T13:20:09.012 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test2 2023-09-28T13:20:09.064 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:09.064 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:20:09.091 INFO:tasks.workunit.client.0.smithi069.stdout:test1 2023-09-28T13:20:09.091 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:09.091 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test2 2023-09-28T13:20:09.118 INFO:tasks.workunit.client.0.smithi069.stdout:test2 2023-09-28T13:20:09.119 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:09.119 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:09.119 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:20:09.145 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:20:09.146 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:20:09.146 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test1.*2.*' 2023-09-28T13:20:09.182 INFO:tasks.workunit.client.0.smithi069.stdout:test1 1 MiB 2 2023-09-28T13:20:09.182 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:20:09.182 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test2.*2.*' 2023-09-28T13:20:09.218 INFO:tasks.workunit.client.0.smithi069.stdout:test2 1 MiB 2 2023-09-28T13:20:09.219 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv test1 2023-09-28T13:20:09.284 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:09.284 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test2 2023-09-28T13:20:09.311 INFO:tasks.workunit.client.0.smithi069.stdout:test2 2023-09-28T13:20:09.311 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:09.311 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:09.312 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:09.338 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:09.338 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:20:09.338 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test2.*2.*' 2023-09-28T13:20:09.373 INFO:tasks.workunit.client.0.smithi069.stdout:test2 1 MiB 2 2023-09-28T13:20:09.373 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:09.373 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:20:09.400 INFO:tasks.workunit.client.0.smithi069.stdout:226e2363fcc4 test1 2023-09-28T13:20:09.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:09.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:09.400 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:09.427 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:09.427 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -l 2023-09-28T13:20:09.427 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test1.*USER.*' 2023-09-28T13:20:09.461 INFO:tasks.workunit.client.0.smithi069.stdout:226e2363fcc4 test1 USER Thu Sep 28 13:20:09 2023 expired at Thu Sep 28 13:20:09 2023 2023-09-28T13:20:09.461 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -l 2023-09-28T13:20:09.462 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v 'protected until' 2023-09-28T13:20:09.495 INFO:tasks.workunit.client.0.smithi069.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-09-28T13:20:09.495 INFO:tasks.workunit.client.0.smithi069.stdout:226e2363fcc4 test1 USER Thu Sep 28 13:20:09 2023 expired at Thu Sep 28 13:20:09 2023 2023-09-28T13:20:09.496 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:09.496 INFO:tasks.workunit.client.0.smithi069.stderr:++ cut -d ' ' -f 1 2023-09-28T13:20:09.523 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=226e2363fcc4 2023-09-28T13:20:09.523 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash rm 226e2363fcc4 2023-09-28T13:20:09.590 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:09.592 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv test2 2023-09-28T13:20:09.658 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:09.658 INFO:tasks.workunit.client.0.smithi069.stderr:++ cut -d ' ' -f 1 2023-09-28T13:20:09.685 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=2271ab0097e4 2023-09-28T13:20:09.685 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info --image-id 2271ab0097e4 2023-09-28T13:20:09.685 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'rbd image '\''test2'\''' 2023-09-28T13:20:09.719 INFO:tasks.workunit.client.0.smithi069.stdout:rbd image 'test2': 2023-09-28T13:20:09.719 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash restore 2271ab0097e4 2023-09-28T13:20:09.758 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:09.759 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test2 2023-09-28T13:20:09.785 INFO:tasks.workunit.client.0.smithi069.stdout:test2 2023-09-28T13:20:09.786 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:20:09.786 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:09.786 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:09.812 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:09.813 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls -l 2023-09-28T13:20:09.813 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test2.*2.*' 2023-09-28T13:20:09.847 INFO:tasks.workunit.client.0.smithi069.stdout:test2 1 MiB 2 2023-09-28T13:20:09.847 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2023-09-28T13:20:09.906 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: image test2 will expire at 2023-09-28T14:20:09.875946+0000 2023-09-28T13:20:09.909 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:09.909 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test2 2023-09-28T13:20:09.936 INFO:tasks.workunit.client.0.smithi069.stdout:2271ab0097e4 test2 2023-09-28T13:20:09.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:09.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:09.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:09.963 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:09.963 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -l 2023-09-28T13:20:09.964 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test2.*USER.*protected until' 2023-09-28T13:20:09.997 INFO:tasks.workunit.client.0.smithi069.stdout:2271ab0097e4 test2 USER Thu Sep 28 13:20:09 2023 protected until Thu Sep 28 14:20:09 2023 2023-09-28T13:20:09.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash rm 2271ab0097e4 2023-09-28T13:20:09.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'Deferment time has not expired' 2023-09-28T13:20:10.026 INFO:tasks.workunit.client.0.smithi069.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2023-09-28T13:20:10.026 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash rm --image-id 2271ab0097e4 --force 2023-09-28T13:20:10.089 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:10.091 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test1 2023-09-28T13:20:10.137 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@snap1 2023-09-28T13:20:10.256 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:10.265 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect test1@snap1 2023-09-28T13:20:10.507 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv test1 2023-09-28T13:20:10.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:10.568 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:20:10.594 INFO:tasks.workunit.client.0.smithi069.stdout:22c8cda42190 test1 2023-09-28T13:20:10.595 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:10.595 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:10.595 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:10.621 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:10.622 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -l 2023-09-28T13:20:10.622 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test1.*USER.*' 2023-09-28T13:20:10.657 INFO:tasks.workunit.client.0.smithi069.stdout:22c8cda42190 test1 USER Thu Sep 28 13:20:10 2023 expired at Thu Sep 28 13:20:10 2023 2023-09-28T13:20:10.657 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -l 2023-09-28T13:20:10.658 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v 'protected until' 2023-09-28T13:20:10.692 INFO:tasks.workunit.client.0.smithi069.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-09-28T13:20:10.693 INFO:tasks.workunit.client.0.smithi069.stdout:22c8cda42190 test1 USER Thu Sep 28 13:20:10 2023 expired at Thu Sep 28 13:20:10 2023 2023-09-28T13:20:10.693 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:10.693 INFO:tasks.workunit.client.0.smithi069.stderr:++ cut -d ' ' -f 1 2023-09-28T13:20:10.720 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=22c8cda42190 2023-09-28T13:20:10.721 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls --image-id 22c8cda42190 2023-09-28T13:20:10.721 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:20:10.721 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:10.721 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:10.755 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:10.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls --image-id 22c8cda42190 2023-09-28T13:20:10.756 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '.*snap1.*' 2023-09-28T13:20:10.792 INFO:tasks.workunit.client.0.smithi069.stdout: 35 snap1 1 MiB yes Thu Sep 28 13:20:10 2023 2023-09-28T13:20:10.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect --image-id 22c8cda42190 --snap snap1 2023-09-28T13:20:10.838 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm --image-id 22c8cda42190 --snap snap1 2023-09-28T13:20:11.243 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:11.256 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls --image-id 22c8cda42190 2023-09-28T13:20:11.256 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:20:11.256 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:11.257 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:11.291 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:11.291 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash restore 22c8cda42190 2023-09-28T13:20:11.329 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@snap1 2023-09-28T13:20:11.758 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:11.772 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@snap2 2023-09-28T13:20:12.763 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:12.778 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls --image-id 22c8cda42190 2023-09-28T13:20:12.778 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:20:12.778 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:12.778 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:20:12.813 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:20:12.813 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge --image-id 22c8cda42190 2023-09-28T13:20:14.766 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:20:14.782 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls --image-id 22c8cda42190 2023-09-28T13:20:14.782 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:20:14.782 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:14.782 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:14.819 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:14.819 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2023-09-28T13:20:14.881 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:14.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:14.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:20:14.910 INFO:tasks.workunit.client.0.smithi069.stdout:22c8cda42190 test1 2023-09-28T13:20:14.911 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:14.911 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:14.911 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:14.937 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:14.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -l 2023-09-28T13:20:14.938 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'test1.*USER.*protected until' 2023-09-28T13:20:14.972 INFO:tasks.workunit.client.0.smithi069.stdout:22c8cda42190 test1 USER Thu Sep 28 13:20:14 2023 protected until Thu Sep 28 14:20:14 2023 2023-09-28T13:20:14.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash rm 22c8cda42190 2023-09-28T13:20:14.972 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'Deferment time has not expired' 2023-09-28T13:20:15.000 INFO:tasks.workunit.client.0.smithi069.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2023-09-28T13:20:15.000 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash rm --image-id 22c8cda42190 --force 2023-09-28T13:20:15.066 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:15.068 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:20:15.068 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.149 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.230 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.310 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.390 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.551 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.631 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.712 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.873 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:15.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.035 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.114 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.195 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.355 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.436 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.516 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_purge 2023-09-28T13:20:16.516 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing trash purge...' 2023-09-28T13:20:16.517 INFO:tasks.workunit.client.0.smithi069.stdout:testing trash purge... 2023-09-28T13:20:16.517 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:20:16.517 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.596 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.676 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.760 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.843 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:16.922 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.001 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.082 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.162 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.242 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.322 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.401 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.481 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.561 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.721 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.802 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.882 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:17.963 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:17.963 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:17.963 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:17.989 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:17.990 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:18.014 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete...done. 2023-09-28T13:20:18.016 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:18.062 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-09-28T13:20:18.108 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg1 2023-09-28T13:20:18.190 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg2 2023-09-28T13:20:18.254 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:18.255 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:18.255 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:20:18.281 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:20:18.281 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:18.390 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 50% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:18.392 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:18.392 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:18.392 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:18.419 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:18.419 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:18.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-09-28T13:20:18.514 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2023-09-28T13:20:18.574 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: image testimg1 will expire at 2023-09-28T14:20:18.544492+0000 2023-09-28T13:20:18.577 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2023-09-28T13:20:18.640 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: image testimg2 will expire at 2023-09-28T16:20:18.605866+0000 2023-09-28T13:20:18.643 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:18.644 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:18.644 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:20:18.670 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:20:18.670 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:18.695 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete...done. 2023-09-28T13:20:18.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:18.697 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:18.698 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:20:18.724 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:20:18.724 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2023-09-28T13:20:18.789 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:18.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:18.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:18.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:19.015 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:19.015+0000 7fcbe6f5a700 0 --2- 172.21.15.69:0/1430610915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556b2c3e56b0 0x556b2c34c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:20:19.020 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:19.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:19.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:19.047 INFO:tasks.workunit.client.0.smithi069.stdout:240c3ef44f1a testimg2 2023-09-28T13:20:19.048 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2023-09-28T13:20:19.117 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:19.121 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:19.121 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:19.121 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:19.147 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:19.148 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:19.193 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1@snap 2023-09-28T13:20:19.768 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:19.784 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-09-28T13:20:19.831 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-09-28T13:20:19.879 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg1 2023-09-28T13:20:19.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg2 2023-09-28T13:20:20.001 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg3 2023-09-28T13:20:20.063 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:20.063 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:20.063 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:20.090 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:20.090 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:20.090 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:20.237 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:20.237 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:20.238 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:20.238 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:20.264 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:20.265 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:20.265 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg1 2023-09-28T13:20:20.291 INFO:tasks.workunit.client.0.smithi069.stdout:242c2fd5c4d9 testimg1 2023-09-28T13:20:20.291 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:20.291 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{ print $1 }' 2023-09-28T13:20:20.319 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=242c2fd5c4d9 2023-09-28T13:20:20.319 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge --image-id 242c2fd5c4d9 2023-09-28T13:20:20.765 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:20:20.775 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:20.839 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:20.842 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:20.842 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:20.842 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:20.868 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:20.869 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:20.912 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-09-28T13:20:20.958 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg2@snap 2023-09-28T13:20:21.779 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:21.789 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-09-28T13:20:21.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg1 2023-09-28T13:20:21.895 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg2 2023-09-28T13:20:21.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg3 2023-09-28T13:20:22.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:22.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:22.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:22.047 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:22.047 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:22.047 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:22.202 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:22.203 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:22.203 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:22.203 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:22.229 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:22.230 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:22.230 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:22.257 INFO:tasks.workunit.client.0.smithi069.stdout:245c5f788b72 testimg2 2023-09-28T13:20:22.257 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:22.257 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{ print $1 }' 2023-09-28T13:20:22.284 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=245c5f788b72 2023-09-28T13:20:22.284 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge --image-id 245c5f788b72 2023-09-28T13:20:22.779 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:20:22.791 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:22.869 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:22.872 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:22.872 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:22.873 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:22.899 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:22.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:22.944 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-09-28T13:20:22.991 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-09-28T13:20:23.036 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg3@snap 2023-09-28T13:20:23.789 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:23.802 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg1 2023-09-28T13:20:23.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg2 2023-09-28T13:20:23.924 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg3 2023-09-28T13:20:23.987 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:23.987 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:23.987 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:24.014 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:24.014 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:24.014 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:24.177 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:24.177 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:24.177 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:24.177 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:24.398 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:24.398+0000 7f92ff0cd700 0 --2- 172.21.15.69:0/954619970 >> v2:172.21.15.69:3300/0 conn(0x5645d61236a0 0x5645d6125a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T13:20:24.405 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:24.405 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:24.405 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg3 2023-09-28T13:20:24.432 INFO:tasks.workunit.client.0.smithi069.stdout:248c8a46a403 testimg3 2023-09-28T13:20:24.433 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:24.433 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{ print $1 }' 2023-09-28T13:20:24.460 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=248c8a46a403 2023-09-28T13:20:24.460 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge --image-id 248c8a46a403 2023-09-28T13:20:24.796 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:20:24.811 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:24.876 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:24.879 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:24.879 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:24.879 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:24.906 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:24.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:24.952 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1@snap 2023-09-28T13:20:25.802 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:25.812 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-09-28T13:20:25.882 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg1@snap 2023-09-28T13:20:25.925 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:25.934 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-09-28T13:20:25.979 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg2@snap 2023-09-28T13:20:26.761 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:26.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-09-28T13:20:26.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-09-28T13:20:26.940 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg2@snap 2023-09-28T13:20:26.990 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:27.000 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg4@snap 2023-09-28T13:20:27.807 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:27.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-09-28T13:20:27.898 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg4@snap 2023-09-28T13:20:27.953 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:27.962 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg1 2023-09-28T13:20:28.024 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg2 2023-09-28T13:20:28.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg3 2023-09-28T13:20:28.149 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg4 2023-09-28T13:20:28.210 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:28.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:28.211 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:28.237 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:28.237 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:28.237 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:28.469 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:28.469 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:28.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:28.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:28.496 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:28.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:28.496 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg1 2023-09-28T13:20:28.523 INFO:tasks.workunit.client.0.smithi069.stdout:24b33078535f testimg1 2023-09-28T13:20:28.524 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:28.524 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:28.550 INFO:tasks.workunit.client.0.smithi069.stdout:24b9cf42d80b testimg2 2023-09-28T13:20:28.550 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:28.550 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg4 2023-09-28T13:20:28.577 INFO:tasks.workunit.client.0.smithi069.stdout:24c52bac6628 testimg4 2023-09-28T13:20:28.577 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg6 2023-09-28T13:20:28.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:28.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:28.641 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:28.666 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:28.667 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:28.667 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:30.003 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:30.004 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:30.004 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:30.004 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:20:30.030 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:20:30.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:30.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg1 2023-09-28T13:20:30.057 INFO:tasks.workunit.client.0.smithi069.stdout:24b33078535f testimg1 2023-09-28T13:20:30.057 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:30.057 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:30.084 INFO:tasks.workunit.client.0.smithi069.stdout:24b9cf42d80b testimg2 2023-09-28T13:20:30.084 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg5 2023-09-28T13:20:30.158 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:30.158 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:30.158 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:30.184 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:30.184 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:30.280 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:30.281+0000 7f7651663700 0 -- 172.21.15.69:0/829001835 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f7630054af0 msgr2=0x7f7630056ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:20:30.290 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:30.291+0000 7f7651e64700 0 -- 172.21.15.69:0/829001835 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f7630054af0 msgr2=0x7f763403d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:20:31.840 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:31.843 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:31.843 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:31.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:31.870 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:31.871 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:31.916 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1@snap 2023-09-28T13:20:32.828 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:32.838 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-09-28T13:20:32.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg1@snap 2023-09-28T13:20:32.950 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:32.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-09-28T13:20:33.005 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg3@snap 2023-09-28T13:20:33.825 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:33.835 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg2@snap 2023-09-28T13:20:34.825 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:34.836 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-09-28T13:20:34.919 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-09-28T13:20:34.993 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg2@snap 2023-09-28T13:20:35.044 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:35.054 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg4@snap 2023-09-28T13:20:35.832 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:35.843 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-09-28T13:20:35.935 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg4@snap 2023-09-28T13:20:35.990 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:35.999 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg1 2023-09-28T13:20:36.064 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg2 2023-09-28T13:20:36.127 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg3 2023-09-28T13:20:36.189 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg4 2023-09-28T13:20:36.249 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:36.249 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:36.249 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:36.275 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:36.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:36.275 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:36.414 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:36.415 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:36.415 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:36.415 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:36.441 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:36.441 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg6 2023-09-28T13:20:36.511 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:36.511 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:36.511 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 5 2023-09-28T13:20:36.537 INFO:tasks.workunit.client.0.smithi069.stdout:5 2023-09-28T13:20:36.538 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:36.538 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:37.060 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:37.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:37.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:37.061 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:37.087 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:37.087 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:37.087 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg1 2023-09-28T13:20:37.114 INFO:tasks.workunit.client.0.smithi069.stdout:2513cafc87d4 testimg1 2023-09-28T13:20:37.114 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:37.114 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:37.141 INFO:tasks.workunit.client.0.smithi069.stdout:251944b62789 testimg2 2023-09-28T13:20:37.142 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:37.142 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg3 2023-09-28T13:20:37.168 INFO:tasks.workunit.client.0.smithi069.stdout:251fabe8404f testimg3 2023-09-28T13:20:37.169 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg5 2023-09-28T13:20:37.235 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:37.235 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:37.235 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:37.261 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:37.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:37.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:38.992 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:38.992 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:38.993 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:38.993 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:39.019 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:39.019 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:39.019 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg3 2023-09-28T13:20:39.046 INFO:tasks.workunit.client.0.smithi069.stdout:251fabe8404f testimg3 2023-09-28T13:20:39.046 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:39.046 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{ print $1 }' 2023-09-28T13:20:39.073 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=251fabe8404f 2023-09-28T13:20:39.074 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge --image-id 251fabe8404f 2023-09-28T13:20:39.836 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:20:39.852 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:39.915 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:39.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:39.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:39.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:39.944 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:39.945 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:39.991 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1@snap 2023-09-28T13:20:40.848 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:40.861 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-09-28T13:20:40.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg1@snap 2023-09-28T13:20:40.980 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:40.989 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-09-28T13:20:41.038 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg2@snap 2023-09-28T13:20:41.764 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:41.774 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-09-28T13:20:41.851 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-09-28T13:20:41.929 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg2@snap 2023-09-28T13:20:41.978 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:41.988 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg4@snap 2023-09-28T13:20:42.846 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:42.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-09-28T13:20:42.959 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg4@snap 2023-09-28T13:20:43.012 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:43.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-09-28T13:20:43.103 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:43.105 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-09-28T13:20:43.186 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:43.189 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg3 2023-09-28T13:20:43.254 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-09-28T13:20:43.342 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:43.345 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:43.345 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:43.345 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:43.372 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:43.372 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:43.372 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:43.601 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:43.601 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:43.601 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:43.601 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:43.627 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:43.628 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:43.628 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg1 2023-09-28T13:20:43.654 INFO:tasks.workunit.client.0.smithi069.stdout:257f6520ecde testimg1 2023-09-28T13:20:43.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:43.655 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:43.681 INFO:tasks.workunit.client.0.smithi069.stdout:25855c32e4d1 testimg2 2023-09-28T13:20:43.682 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:43.682 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg4 2023-09-28T13:20:43.708 INFO:tasks.workunit.client.0.smithi069.stdout:259169397568 testimg4 2023-09-28T13:20:43.709 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg6 2023-09-28T13:20:43.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:43.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:43.773 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:43.799 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:43.800 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:43.800 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:44.950 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:44.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:44.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:44.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 2 2023-09-28T13:20:44.977 INFO:tasks.workunit.client.0.smithi069.stdout:2 2023-09-28T13:20:44.978 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:44.978 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg1 2023-09-28T13:20:45.005 INFO:tasks.workunit.client.0.smithi069.stdout:257f6520ecde testimg1 2023-09-28T13:20:45.005 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:45.005 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:45.032 INFO:tasks.workunit.client.0.smithi069.stdout:25855c32e4d1 testimg2 2023-09-28T13:20:45.032 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg5 2023-09-28T13:20:45.097 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:45.098 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:45.098 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:45.124 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:45.124 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:45.220 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:45.220+0000 7f79117de700 0 -- 172.21.15.69:0/1927207236 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f78f0054af0 msgr2=0x7f78f0056ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:20:45.232 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:20:45.231+0000 7f79117de700 0 -- 172.21.15.69:0/1927207236 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7f78f403a750 msgr2=0x7f78f403cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:20:46.921 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:46.924 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:46.925 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:46.925 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:46.951 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:46.951 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-09-28T13:20:46.997 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1@snap 2023-09-28T13:20:47.854 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:47.864 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-09-28T13:20:47.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg1@snap 2023-09-28T13:20:47.980 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:47.989 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-09-28T13:20:48.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg3@snap 2023-09-28T13:20:48.859 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:48.869 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg2@snap 2023-09-28T13:20:49.869 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:49.879 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-09-28T13:20:49.958 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-09-28T13:20:50.043 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg2@snap 2023-09-28T13:20:50.096 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:50.106 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg4@snap 2023-09-28T13:20:50.868 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:50.881 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-09-28T13:20:50.961 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm testimg4@snap 2023-09-28T13:20:51.017 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:20:51.028 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-09-28T13:20:51.112 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:51.114 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-09-28T13:20:51.198 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:51.200 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg3 2023-09-28T13:20:51.262 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-09-28T13:20:51.346 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:20:51.349 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:51.349 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:51.349 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:51.376 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:51.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:51.376 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:51.515 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:51.516 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:51.516 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:51.516 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:51.543 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:51.543 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg6 2023-09-28T13:20:51.605 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:51.605 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:51.605 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 5 2023-09-28T13:20:51.631 INFO:tasks.workunit.client.0.smithi069.stdout:5 2023-09-28T13:20:51.632 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:51.632 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:52.909 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:52.910 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:52.910 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:52.910 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 3 2023-09-28T13:20:52.936 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:20:52.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:52.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg1 2023-09-28T13:20:52.963 INFO:tasks.workunit.client.0.smithi069.stdout:25df631ecdf6 testimg1 2023-09-28T13:20:52.964 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:52.964 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg2 2023-09-28T13:20:52.990 INFO:tasks.workunit.client.0.smithi069.stdout:25e5921897f8 testimg2 2023-09-28T13:20:52.991 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:52.991 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg3 2023-09-28T13:20:53.017 INFO:tasks.workunit.client.0.smithi069.stdout:25eb4e4db526 testimg3 2023-09-28T13:20:53.018 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash mv testimg5 2023-09-28T13:20:53.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:53.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:53.086 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 4 2023-09-28T13:20:53.112 INFO:tasks.workunit.client.0.smithi069.stdout:4 2023-09-28T13:20:53.113 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:53.113 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'some expired images could not be removed' 2023-09-28T13:20:54.980 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: some expired images could not be removed 2023-09-28T13:20:54.981 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:54.981 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:54.981 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:20:55.008 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:20:55.008 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:55.008 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep testimg3 2023-09-28T13:20:55.035 INFO:tasks.workunit.client.0.smithi069.stdout:25eb4e4db526 testimg3 2023-09-28T13:20:55.035 INFO:tasks.workunit.client.0.smithi069.stderr:++ rbd trash ls 2023-09-28T13:20:55.035 INFO:tasks.workunit.client.0.smithi069.stderr:++ awk '{ print $1 }' 2023-09-28T13:20:55.062 INFO:tasks.workunit.client.0.smithi069.stderr:+ ID=25eb4e4db526 2023-09-28T13:20:55.063 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge --image-id 25eb4e4db526 2023-09-28T13:20:55.867 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:20:55.879 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash purge 2023-09-28T13:20:55.951 INFO:tasks.workunit.client.0.smithi069.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-09-28T13:20:55.954 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls 2023-09-28T13:20:55.954 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:20:55.954 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 0 2023-09-28T13:20:55.981 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:20:55.981 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_deep_copy_clone 2023-09-28T13:20:55.981 INFO:tasks.workunit.client.0.smithi069.stdout:testing deep copy clone... 2023-09-28T13:20:55.982 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing deep copy clone...' 2023-09-28T13:20:55.982 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:20:55.982 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.068 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.150 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.233 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.316 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.600 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.681 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.765 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.852 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:56.936 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.020 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.308 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.392 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.476 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.564 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.645 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.730 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.817 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:20:57.905 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create testimg1 --image-format 2 --size 256 2023-09-28T13:20:57.956 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg1 --snap=snap1 2023-09-28T13:20:58.880 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:58.891 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect testimg1@snap1 2023-09-28T13:20:58.937 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone testimg1@snap1 testimg2 2023-09-28T13:20:59.022 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg2@snap2 2023-09-28T13:20:59.890 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:20:59.902 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep copy testimg2 testimg3 2023-09-28T13:21:00.004 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:00.003+0000 7fd1d474a700 0 -- 172.21.15.69:0/3188385192 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x556a9794c8a0 msgr2=0x556a97a39d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:00.899 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete...2023-09-28T13:21:00.898+0000 7fd1d474a700 0 -- 172.21.15.69:0/3188385192 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fd1b803a690 msgr2=0x7fd1b803ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:21:00.903 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 100% complete...done. 2023-09-28T13:21:00.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg3 2023-09-28T13:21:00.906 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:21:00.952 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:21:00.953 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg3 2023-09-28T13:21:00.953 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'parent: rbd/testimg1@snap1' 2023-09-28T13:21:00.994 INFO:tasks.workunit.client.0.smithi069.stdout: parent: rbd/testimg1@snap1 2023-09-28T13:21:00.995 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg3 2023-09-28T13:21:00.995 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:21:00.995 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:21:00.995 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:21:01.036 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:21:01.037 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg3 2023-09-28T13:21:01.037 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '.*snap2.*' 2023-09-28T13:21:01.077 INFO:tasks.workunit.client.0.smithi069.stdout: 77 snap2 256 MiB Thu Sep 28 13:21:00 2023 2023-09-28T13:21:01.078 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg2 2023-09-28T13:21:01.078 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'features:.*deep-flatten' 2023-09-28T13:21:01.118 INFO:tasks.workunit.client.0.smithi069.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-09-28T13:21:01.119 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg3 2023-09-28T13:21:01.119 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'features:.*deep-flatten' 2023-09-28T13:21:01.160 INFO:tasks.workunit.client.0.smithi069.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-09-28T13:21:01.160 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd flatten testimg2 2023-09-28T13:21:01.214 INFO:tasks.workunit.client.0.smithi069.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-09-28T13:21:01.221 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd flatten testimg3 2023-09-28T13:21:01.274 INFO:tasks.workunit.client.0.smithi069.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-09-28T13:21:01.285 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect testimg1@snap1 2023-09-28T13:21:01.334 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge testimg2 2023-09-28T13:21:01.759 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:21:01.771 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap purge testimg3 2023-09-28T13:21:02.767 INFO:tasks.workunit.client.0.smithi069.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-09-28T13:21:02.779 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm testimg2 2023-09-28T13:21:02.904 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-09-28T13:21:02.903+0000 7fbe64d28700 0 -- 172.21.15.69:0/2045695756 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x558f6617bc10 msgr2=0x558f66153a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:02.905 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:02.907 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm testimg3 2023-09-28T13:21:03.030 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-09-28T13:21:03.029+0000 7f02f8357700 0 -- 172.21.15.69:0/3775641999 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f02d4006540 msgr2=0x7f02d40148e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:21:03.030 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:03.033 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect testimg1@snap1 2023-09-28T13:21:03.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone testimg1@snap1 testimg2 2023-09-28T13:21:03.154 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create testimg2@snap2 2023-09-28T13:21:03.893 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:21:03.903 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd deep copy --flatten testimg2 testimg3 2023-09-28T13:21:05.033 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete...2023-09-28T13:21:05.030+0000 7f1120d26700 0 -- 172.21.15.69:0/673034470 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f10fc008740 msgr2=0x7f10fc00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:05.093 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 6% complete...2023-09-28T13:21:05.092+0000 7f1120d26700 0 -- 172.21.15.69:0/673034470 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f110403af10 msgr2=0x7f110403d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:05.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:21:05.120+0000 7f96ea87f700 -1 reset not still connected to 0x56356568b930 2023-09-28T13:21:05.793 INFO:tasks.workunit.client.0.smithi069.stderr: Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-09-28T13:21:05.796 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg3 2023-09-28T13:21:05.796 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'size 256 MiB' 2023-09-28T13:21:06.033 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:21:06.033 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg3 2023-09-28T13:21:06.034 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v parent: 2023-09-28T13:21:06.068 INFO:tasks.workunit.client.0.smithi069.stdout:rbd image 'testimg3': 2023-09-28T13:21:06.068 INFO:tasks.workunit.client.0.smithi069.stdout: size 256 MiB in 64 objects 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: order 22 (4 MiB objects) 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: snapshot_count: 1 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: id: 26f776b8b414 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: block_name_prefix: rbd_data.26f776b8b414 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: format: 2 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: op_features: 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: flags: 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: create_timestamp: Thu Sep 28 13:21:03 2023 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: access_timestamp: Thu Sep 28 13:21:03 2023 2023-09-28T13:21:06.069 INFO:tasks.workunit.client.0.smithi069.stdout: modify_timestamp: Thu Sep 28 13:21:03 2023 2023-09-28T13:21:06.070 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg3 2023-09-28T13:21:06.070 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -v SNAPID 2023-09-28T13:21:06.070 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:21:06.070 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 1 2023-09-28T13:21:06.103 INFO:tasks.workunit.client.0.smithi069.stdout:1 2023-09-28T13:21:06.104 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap ls testimg3 2023-09-28T13:21:06.104 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '.*snap2.*' 2023-09-28T13:21:06.138 INFO:tasks.workunit.client.0.smithi069.stdout: 81 snap2 256 MiB Thu Sep 28 13:21:04 2023 2023-09-28T13:21:06.138 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd info testimg2 2023-09-28T13:21:06.139 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'features:.*deep-flatten' 2023-09-28T13:21:06.179 INFO:tasks.workunit.client.0.smithi069.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-09-28T13:21:06.179 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd flatten testimg2 2023-09-28T13:21:06.230 INFO:tasks.workunit.client.0.smithi069.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-09-28T13:21:06.240 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect testimg1@snap1 2023-09-28T13:21:06.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:21:06.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:07.093 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:08.052 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.144 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.228 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.311 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.394 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.478 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.563 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.647 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.733 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.816 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.899 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:09.984 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.155 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.238 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.325 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.408 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_clone_v2 2023-09-28T13:21:10.408 INFO:tasks.workunit.client.0.smithi069.stdout:testing clone v2... 2023-09-28T13:21:10.409 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing clone v2...' 2023-09-28T13:21:10.409 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:21:10.409 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.492 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.575 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.659 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.743 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.908 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:10.994 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.079 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.161 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.445 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.527 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.609 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.694 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.782 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.865 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:11.948 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:12.031 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:12.114 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test1 2023-09-28T13:21:12.166 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@1 2023-09-28T13:21:12.917 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:21:12.928 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2023-09-28T13:21:12.964 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:12.964+0000 7fd53967d700 -1 librbd::image::CloneRequest: 0x55a9c6318680 validate_parent: parent snapshot must be protected 2023-09-28T13:21:12.964 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: clone error: (22) Invalid argument 2023-09-28T13:21:12.966 INFO:tasks.workunit.client.0.smithi069.stderr:+ true 2023-09-28T13:21:12.967 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2023-09-28T13:21:13.044 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2023-09-28T13:21:13.118 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap protect test1@1 2023-09-28T13:21:13.163 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2023-09-28T13:21:13.244 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd children test1@1 2023-09-28T13:21:13.244 INFO:tasks.workunit.client.0.smithi069.stderr:+ sort 2023-09-28T13:21:13.244 INFO:tasks.workunit.client.0.smithi069.stderr:+ tr '\n' ' ' 2023-09-28T13:21:13.244 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -E 'test2.*test3.*test4' 2023-09-28T13:21:13.285 INFO:tasks.workunit.client.0.smithi069.stdout:rbd/test2 rbd/test3 rbd/test4 2023-09-28T13:21:13.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd children --descendants test1 2023-09-28T13:21:13.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ sort 2023-09-28T13:21:13.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ tr '\n' ' ' 2023-09-28T13:21:13.286 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -E 'test2.*test3.*test4' 2023-09-28T13:21:13.339 INFO:tasks.workunit.client.0.smithi069.stdout:rbd/test2 rbd/test3 rbd/test4 2023-09-28T13:21:13.339 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd remove test4 2023-09-28T13:21:13.465 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:13.465+0000 7f00758ae700 0 -- 172.21.15.69:0/550430702 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f0054008740 msgr2=0x7f005400abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:21:13.469 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:13.471 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap unprotect test1@1 2023-09-28T13:21:13.518 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap remove test1@1 2023-09-28T13:21:13.564 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:21:13.574 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap list --all test1 2023-09-28T13:21:13.575 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep -E 'trash \(1\) *$' 2023-09-28T13:21:13.610 INFO:tasks.workunit.client.0.smithi069.stdout: 85 d25e1d69-db25-43bd-abc9-6d973e24264f 1 MiB Thu Sep 28 13:21:12 2023 trash (1) 2023-09-28T13:21:13.611 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@2 2023-09-28T13:21:13.922 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:21:13.932 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:21:13.933 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'image has snapshots' 2023-09-28T13:21:13.994 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2023-09-28T13:21:13.994 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm test1@2 2023-09-28T13:21:14.922 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:21:14.934 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:21:14.934 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'linked clones' 2023-09-28T13:21:15.001 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-09-28T13:21:15.001 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test3 2023-09-28T13:21:15.120 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:15.121+0000 7fca7405f700 0 -- 172.21.15.69:0/822446839 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x56369a67c980 msgr2=0x56369a722ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:21:15.136 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:15.139 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:21:15.139 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep 'linked clones' 2023-09-28T13:21:15.201 INFO:tasks.workunit.client.0.smithi069.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-09-28T13:21:15.201 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd flatten test2 2023-09-28T13:21:15.943 INFO:tasks.workunit.client.0.smithi069.stderr: Image flatten: 100% complete...done. 2023-09-28T13:21:15.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap list --all test1 2023-09-28T13:21:15.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:21:15.957 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:21:15.992 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:21:15.992 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:21:16.134 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:16.134+0000 7faec352e700 0 -- 172.21.15.69:0/4147311728 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x55b5256e6180 msgr2=0x55b52569c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:16.134 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:16.137 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:21:16.262 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:16.262+0000 7f6b929a0700 0 -- 172.21.15.69:0/3848844332 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f6b70006500 msgr2=0x7f6b70011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:16.262 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:16.265 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 -s 1 test1 2023-09-28T13:21:16.314 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@1 2023-09-28T13:21:16.779 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:21:16.790 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap create test1@2 2023-09-28T13:21:17.775 INFO:tasks.workunit.client.0.smithi069.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-09-28T13:21:17.792 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2023-09-28T13:21:17.870 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2023-09-28T13:21:17.942 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm test1@1 2023-09-28T13:21:17.986 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:21:17.996 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd snap rm test1@2 2023-09-28T13:21:18.040 INFO:tasks.workunit.client.0.smithi069.stderr: Removing snap: 100% complete...done. 2023-09-28T13:21:18.050 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd rm test1 2023-09-28T13:21:18.050 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:21:18.101 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:18.101+0000 7efd226c8500 -1 librbd::api::Image: remove: image has snapshots - not removing 2023-09-28T13:21:18.101 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 0% complete...failed. 2023-09-28T13:21:18.107 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-09-28T13:21:18.110 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:21:18.110 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2023-09-28T13:21:18.203 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:18.205 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -a 2023-09-28T13:21:18.205 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:21:18.233 INFO:tasks.workunit.client.0.smithi069.stdout:282b39934c28 test1 2023-09-28T13:21:18.233 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test2 2023-09-28T13:21:18.349 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:18.349+0000 7f0d0b585700 0 -- 172.21.15.69:0/1305931867 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f0cf00064f0 msgr2=0x7f0cf0011eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:18.917 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:18.917+0000 7f0d0b585700 0 -- 172.21.15.69:0/1305931867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f3be03b2c0 msgr2=0x55f3be0c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:18.977 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:18.980 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -a 2023-09-28T13:21:18.980 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:21:19.008 INFO:tasks.workunit.client.0.smithi069.stdout:282b39934c28 test1 2023-09-28T13:21:19.009 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test3 2023-09-28T13:21:19.119 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:19.119+0000 7f80c0fc4700 0 -- 172.21.15.69:0/766599227 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f809c008740 msgr2=0x7f809c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:19.133 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:19.133+0000 7f80c0fc4700 0 -- 172.21.15.69:0/766599227 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f80a403a750 msgr2=0x7f80a403cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:19.982 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:19.985 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd trash ls -a 2023-09-28T13:21:19.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail grep test1 2023-09-28T13:21:19.986 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:21:20.013 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:21:20.014 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_thick_provision 2023-09-28T13:21:20.014 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing thick provision...' 2023-09-28T13:21:20.014 INFO:tasks.workunit.client.0.smithi069.stdout:testing thick provision... 2023-09-28T13:21:20.014 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:21:20.014 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.098 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.183 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.265 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.348 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.431 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.513 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.681 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.764 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.850 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:20.933 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:21.016 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:21.100 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:21.186 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:21.470 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:21.555 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:21.640 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:21.725 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2023-09-28T13:21:22.048 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-09-28T13:21:22.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ count=0 2023-09-28T13:21:22.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret= 2023-09-28T13:21:22.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 -lt 10 ']' 2023-09-28T13:21:22.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:21:22.060 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:21:22.061 INFO:tasks.workunit.client.0.smithi069.stderr:+ tr -s ' ' 2023-09-28T13:21:22.061 INFO:tasks.workunit.client.0.smithi069.stderr:+ cut -d ' ' -f 4-5 2023-09-28T13:21:22.061 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^64 MiB' 2023-09-28T13:21:22.093 INFO:tasks.workunit.client.0.smithi069.stdout:64 MiB 2023-09-28T13:21:22.094 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret=0 2023-09-28T13:21:22.094 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 = 0 ']' 2023-09-28T13:21:22.094 INFO:tasks.workunit.client.0.smithi069.stderr:+ break 2023-09-28T13:21:22.094 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:21:22.124 INFO:tasks.workunit.client.0.smithi069.stdout:NAME PROVISIONED USED 2023-09-28T13:21:22.125 INFO:tasks.workunit.client.0.smithi069.stdout:test1 64 MiB 64 MiB 2023-09-28T13:21:22.127 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 '!=' 0 ']' 2023-09-28T13:21:22.127 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:21:22.252 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2023-09-28T13:21:22.251+0000 7fbcfe908700 0 -- 172.21.15.69:0/3088934191 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x557e037b7bd0 msgr2=0x557e03858cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:22.303 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 100% complete...done. 2023-09-28T13:21:22.306 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:21:22.306 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:21:22.306 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:21:22.307 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:21:22.333 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:21:22.333 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2023-09-28T13:21:22.780 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete...2023-09-28T13:21:22.779+0000 7f76e1485700 0 -- 172.21.15.69:0/1746760965 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x561aa918dd20 msgr2=0x561aa9180b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:22.872 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 6% complete...2023-09-28T13:21:22.871+0000 7f76e1485700 0 -- 172.21.15.69:0/1746760965 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f76c003a740 msgr2=0x7f76c003cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:33.018 INFO:tasks.workunit.client.0.smithi069.stderr: Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete... Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-09-28T13:21:33.029 INFO:tasks.workunit.client.0.smithi069.stderr:+ count=0 2023-09-28T13:21:33.029 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret= 2023-09-28T13:21:33.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 -lt 10 ']' 2023-09-28T13:21:33.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:21:33.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:21:33.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ tr -s ' ' 2023-09-28T13:21:33.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ cut -d ' ' -f 4-5 2023-09-28T13:21:33.030 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^4 GiB' 2023-09-28T13:21:33.064 INFO:tasks.workunit.client.0.smithi069.stdout:4 GiB 2023-09-28T13:21:33.065 INFO:tasks.workunit.client.0.smithi069.stderr:+ ret=0 2023-09-28T13:21:33.065 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 = 0 ']' 2023-09-28T13:21:33.065 INFO:tasks.workunit.client.0.smithi069.stderr:+ break 2023-09-28T13:21:33.065 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd du 2023-09-28T13:21:33.095 INFO:tasks.workunit.client.0.smithi069.stdout:NAME PROVISIONED USED 2023-09-28T13:21:33.096 INFO:tasks.workunit.client.0.smithi069.stdout:test1 4 GiB 4 GiB 2023-09-28T13:21:33.098 INFO:tasks.workunit.client.0.smithi069.stderr:+ '[' 0 '!=' 0 ']' 2023-09-28T13:21:33.098 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd rm test1 2023-09-28T13:21:33.216 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 1% complete...2023-09-28T13:21:33.216+0000 7f84361b5700 0 -- 172.21.15.69:0/232690555 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7f841c008740 msgr2=0x7f841c00abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:33.237 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 2% complete... Removing image: 3% complete...2023-09-28T13:21:33.236+0000 7f84369b6700 0 -- 172.21.15.69:0/232690555 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55e113fbd670 msgr2=0x55e1140618c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T13:21:34.279 INFO:tasks.workunit.client.0.smithi069.stderr: Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-09-28T13:21:34.282 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd ls 2023-09-28T13:21:34.282 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test1 2023-09-28T13:21:34.282 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:21:34.283 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:21:34.309 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:21:34.310 INFO:tasks.workunit.client.0.smithi069.stderr:+ test_namespace 2023-09-28T13:21:34.310 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo 'testing namespace...' 2023-09-28T13:21:34.310 INFO:tasks.workunit.client.0.smithi069.stdout:testing namespace... 2023-09-28T13:21:34.310 INFO:tasks.workunit.client.0.smithi069.stderr:+ remove_images 2023-09-28T13:21:34.311 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.395 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.480 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.571 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.657 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.742 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.826 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.912 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:34.998 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.084 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.170 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.257 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.342 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.427 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.512 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.597 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.683 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.770 INFO:tasks.workunit.client.0.smithi069.stderr:+ for img in $IMGS 2023-09-28T13:21:35.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace ls 2023-09-28T13:21:35.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:21:35.857 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^0$' 2023-09-28T13:21:35.883 INFO:tasks.workunit.client.0.smithi069.stdout:0 2023-09-28T13:21:35.884 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace create rbd/test1 2023-09-28T13:21:35.918 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace create --pool rbd --namespace test2 2023-09-28T13:21:35.954 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace create --namespace test3 2023-09-28T13:21:35.989 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd namespace create rbd/test3 2023-09-28T13:21:35.989 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace create rbd/test3 2023-09-28T13:21:36.019 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: failed to created namespace: (17) File exists 2023-09-28T13:21:36.019 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:36.018+0000 7f3d28be5500 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2023-09-28T13:21:36.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:21:36.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace list 2023-09-28T13:21:36.021 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep test 2023-09-28T13:21:36.022 INFO:tasks.workunit.client.0.smithi069.stderr:+ wc -l 2023-09-28T13:21:36.022 INFO:tasks.workunit.client.0.smithi069.stderr:+ grep '^3$' 2023-09-28T13:21:36.048 INFO:tasks.workunit.client.0.smithi069.stdout:3 2023-09-28T13:21:36.049 INFO:tasks.workunit.client.0.smithi069.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2023-09-28T13:21:36.049 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd namespace remove --pool rbd missing 2023-09-28T13:21:36.070 INFO:tasks.workunit.client.0.smithi069.stderr:rbd: namespace name was not specified 2023-09-28T13:21:36.071 INFO:tasks.workunit.client.0.smithi069.stderr:+ return 0 2023-09-28T13:21:36.072 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2023-09-28T13:21:36.134 INFO:tasks.workunit.client.0.smithi069.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2023-09-28T13:21:36.185 INFO:tasks.workunit.client.0.smithi069.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2023-09-28T13:21:36.194 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T13:21:36.193+0000 7fcd7ebd3700 0 -- 172.21.15.69:0/2655470317 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55d45ba84240 msgr2=0x55d45ba86620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T13:21:40.112 INFO:tasks.workunit.client.0.smithi069.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-09-28T13:21:40.112 INFO:tasks.workunit.client.0.smithi069.stdout: 3 2512 643.926 2.5 MiB/s 2023-09-28T13:21:40.529 INFO:tasks.workunit.client.0.smithi069.stdout: 4 2528 585.783 2.3 MiB/s 2023-09-28T13:22:10.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:10.941+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:11.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:11.183+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:11.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:11.942+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:12.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:12.168+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:12.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:12.964+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:13.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:13.192+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:13.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:13.995+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:14.237 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:14.236+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:15.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:15.031+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:15.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:15.226+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:16.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:16.015+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:16.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:16.231+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:17.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:17.039+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:17.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:17.218+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:18.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:18.089+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:18.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:18.244+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:19.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:19.059+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:19.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:19.195+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:20.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:20.045+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:20.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:20.177+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:21.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:21.065+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:21.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:21.137+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:22.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:22.077+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:22.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:22.141+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:23.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:23.117+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:23.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:23.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:24.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:24.099+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:24.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:24.111+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:25.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:25.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:25.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:25.119+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:26.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:26.078+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:26.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:26.092+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:27.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:27.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:27.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:27.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:28.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:28.016+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:28.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:28.035+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:29.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:29.025+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:29.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:29.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:30.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:30.035+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:30.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:30.043+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:30.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:30.998+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:31.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:31.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:32.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:32.018+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:32.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:32.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:32.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:32.990+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:33.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:33.101+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:33.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:33.994+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:34.137 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:34.136+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:34.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:34.945+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:35.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:35.176+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:35.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:35.896+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:36.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:36.171+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:36.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:36.862+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:37.198 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:37.198+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:37.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:37.877+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:38.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:38.224+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:38.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:38.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:39.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:39.218+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:39.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:39.935+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:40.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:40.249+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:40.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:40.955+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:41.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:41.256+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:41.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:41.940+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:42.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:42.249+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:42.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:42.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:43.221 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:43.220+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:43.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:43.957+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:44.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:44.235+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:45.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:45.002+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:45.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:45.215+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:45.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:45.997+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:46.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:46.192+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:46.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:46.948+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:47.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:47.192+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:47.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:47.959+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:48.169 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:48.169+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:48.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:48.945+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:49.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:49.161+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:49.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:49.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:50.115 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:50.115+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:50.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:50.989+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:51.100 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:51.100+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:51.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:51.973+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:52.129 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:52.129+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:52.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:52.924+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:53.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:53.093+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:53.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:53.912+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:54.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:54.140+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:54.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:54.893+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:55.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:55.139+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:55.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:55.883+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:56.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:56.105+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:56.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:56.918+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:57.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:57.145+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:57.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:57.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:58.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:58.192+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:58.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:58.972+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:59.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:22:59.208+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:22:59.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:22:59.956+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:00.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:00.208+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:00.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:00.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:01.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:01.204+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:01.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:01.904+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:02.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:02.232+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:02.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:02.910+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:03.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:03.193+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:03.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:03.874+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:04.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:04.154+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:04.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:04.846+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:05.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:05.117+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:05.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:05.856+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:06.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:06.149+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:06.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:06.889+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:07.122 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:07.122+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:07.858 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:07.858+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:08.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:08.150+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:08.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:08.863+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:09.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:09.113+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:09.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:09.876+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:10.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:10.124+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:10.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:10.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:11.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:11.133+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:11.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:11.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:12.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:12.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:12.870 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:12.869+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:13.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:13.047+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:13.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:13.846+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:14.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:14.068+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:14.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:14.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:15.091 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:15.090+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:15.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:15.918+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:16.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:16.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:16.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:16.942+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:17.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:17.038+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:17.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:17.972+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:18.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:18.079+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:18.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:18.977+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:19.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:19.124+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:19.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:19.952+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:20.115 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:20.114+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:20.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:20.960+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:21.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:21.156+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:21.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:21.937+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:22.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:22.179+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:22.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:22.960+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:23.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:23.191+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:23.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:23.925+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:24.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:24.242+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:24.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:24.971+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:25.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:25.280+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:25.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:25.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:26.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:26.328+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:27.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:27.041+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:27.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:27.334+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:28.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:28.048+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:28.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:28.322+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:29.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:29.008+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:29.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:29.276+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:29.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:29.962+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:30.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:30.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:30.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:30.988+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:31.258 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:31.258+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:32.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:32.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:32.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:32.264+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:33.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:33.051+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:33.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:33.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:34.097 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:34.097+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:34.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:34.284+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:35.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:35.056+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:35.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:35.317+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:36.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:36.008+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:36.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:36.309+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:37.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:37.031+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:37.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:37.348+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:38.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:38.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:38.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:38.379+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:39.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:39.126+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:39.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:39.341+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:40.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:40.107+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:40.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:40.315+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:41.131 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:41.130+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:41.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:41.315+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:42.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:42.093+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:42.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:42.272+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:43.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:43.108+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:43.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:43.284+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:44.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:44.103+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:44.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:44.312+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:45.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:45.149+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:45.301 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:45.300+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:46.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:46.127+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:46.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:46.294+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:47.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:47.177+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:47.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:47.310+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:48.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:48.193+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:48.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:48.355+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:49.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:49.231+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:49.373 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:49.372+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:50.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:50.214+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:50.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:50.422+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:51.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:51.224+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:51.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:51.382+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:52.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:52.236+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:52.418 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:52.417+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:53.282 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:53.281+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:53.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:53.455+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:54.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:54.251+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:54.416 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:54.415+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:55.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:55.253+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:55.373 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:55.372+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:56.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:56.208+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:56.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:56.380+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:57.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:57.253+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:57.410 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:57.409+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:58.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:58.283+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:58.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:58.441+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:59.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:23:59.318+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:23:59.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:23:59.409+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:00.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:00.363+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:00.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:00.382+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:01.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:01.382+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:01.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:01.393+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:02.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:02.358+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:02.419 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:02.419+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:03.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:03.319+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:03.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:03.427+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:04.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:04.345+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:04.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:04.401+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:05.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:05.332+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:05.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:05.357+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:06.291 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:06.291+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:06.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:06.309+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:07.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:07.291+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:07.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:07.303+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:08.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:08.263+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:08.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:08.338+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:09.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:09.306+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:09.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:09.367+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:10.319 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:10.319+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:10.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:10.351+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:11.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:11.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:11.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:11.361+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:12.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:12.365+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:12.375 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:12.375+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:13.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:13.358+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:13.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:13.385+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:14.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:14.337+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:14.408 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:14.407+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:15.363 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:15.363+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:15.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:15.453+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:16.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:16.349+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:16.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:16.427+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:17.314 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:17.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:17.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:17.434+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:18.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:18.306+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:18.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:18.452+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:19.291 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:19.291+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:19.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:19.440+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:20.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:20.328+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:20.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:20.449+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:21.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:21.281+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:21.490 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:21.490+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:22.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:22.317+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:22.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:22.529+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:23.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:23.289+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:23.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:23.502+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:24.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:24.304+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:24.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:24.552+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:25.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:25.353+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:25.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:25.572+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:26.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:26.333+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:26.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:26.533+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:27.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:27.296+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:27.486 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:27.485+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:28.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:28.342+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:28.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:28.464+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:29.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:29.388+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:29.439 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:29.438+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:30.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:30.396+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:30.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:30.430+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:31.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:31.433+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:31.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:31.447+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:32.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:32.390+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:32.432 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:32.431+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:33.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:33.376+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:33.398 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:33.397+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:34.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:34.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:34.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:34.406+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:35.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:35.390+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:35.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:35.396+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:36.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:36.394+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:36.398 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:36.398+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:37.363 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:37.362+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:37.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:37.378+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:38.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:38.355+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:38.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:38.356+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:39.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:39.337+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:39.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:39.372+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:40.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:40.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:40.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:40.416+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:41.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:41.308+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:41.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:41.388+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:42.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:42.314+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:42.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:42.347+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:43.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:43.302+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:43.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:43.347+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:44.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:44.318+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:44.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:44.330+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:45.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:45.286+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:45.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:45.307+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:46.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:46.319+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:46.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:46.326+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:47.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:47.292+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:47.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:47.350+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:48.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:48.286+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:48.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:48.324+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:49.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:49.298+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:49.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:49.304+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:50.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:50.258+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:50.260 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:50.259+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:51.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:51.250+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:51.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:51.256+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:52.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:52.218+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:52.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:52.264+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:53.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:53.254+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:53.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:53.283+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:54.270 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:54.269+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:54.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:54.332+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:55.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:55.239+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:55.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:55.333+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:56.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:56.287+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:56.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:56.338+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:57.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:57.336+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:57.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:57.381+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:58.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:58.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:58.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:58.400+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:59.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:24:59.306+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:24:59.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:24:59.390+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:00.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:00.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:00.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:00.385+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:01.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:01.253+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:01.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:01.421+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:02.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:02.231+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:02.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:02.395+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:03.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:03.233+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:03.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:03.443+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:04.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:04.211+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:04.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:04.435+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:05.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:05.257+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:05.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:05.455+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:06.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:06.275+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:06.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:06.446+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:07.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:07.252+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:07.429 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:07.429+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:08.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:08.269+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:08.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:08.403+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:09.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:09.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:09.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:09.379+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:10.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:10.239+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:10.375 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:10.375+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:11.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:11.203+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:11.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:11.406+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:12.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:12.162+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:12.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:12.395+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:13.179 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:13.178+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:13.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:13.380+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:14.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:14.204+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:14.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:14.427+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:15.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:15.199+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:15.466 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:15.466+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:16.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:16.182+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:16.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:16.514+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:17.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:17.197+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:17.482 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:17.481+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:18.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:18.238+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:18.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:18.462+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:19.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:19.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:19.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:19.491+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:20.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:20.294+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:20.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:20.494+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:21.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:21.294+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:21.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:21.468+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:22.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:22.290+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:22.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:22.454+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:23.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:23.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:23.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:23.459+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:24.260 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:24.259+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:24.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:24.462+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:25.302 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:25.301+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:25.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:25.449+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:26.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:26.350+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:26.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:26.470+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:27.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:27.332+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:27.438 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:27.438+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:28.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:28.340+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:28.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:28.398+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:29.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:29.389+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:29.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:29.410+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:30.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:30.430+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:30.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:30.450+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:31.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:31.404+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:31.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:31.498+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:32.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:32.368+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:32.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:32.460+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:33.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:33.360+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:33.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:33.426+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:34.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:34.406+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:34.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:34.444+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:35.425 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:35.424+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:35.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:35.450+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:36.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:36.413+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:36.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:36.476+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:37.398 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:37.397+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:37.485 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:37.484+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:38.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:38.408+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:38.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:38.513+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:39.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:39.454+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:39.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:39.476+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:40.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:40.416+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:40.490 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:40.490+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:41.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:41.389+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:41.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:41.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:42.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:42.421+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:42.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:42.526+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:43.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:43.446+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:43.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:43.540+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:44.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:44.429+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:44.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:44.585+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:45.477 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:45.476+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:45.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:45.610+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:46.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:46.485+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:46.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:46.562+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:47.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:47.473+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:47.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:47.518+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:48.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:48.484+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:48.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:48.554+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:49.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:49.514+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:49.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:49.528+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:50.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:50.502+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:50.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:50.558+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:51.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:51.474+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:51.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:51.561+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:52.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:52.521+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:52.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:52.546+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:53.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:53.542+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:53.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:53.580+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:54.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:54.514+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:54.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:54.608+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:55.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:55.522+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:55.644 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:55.644+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:56.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:56.514+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:56.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:56.656+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:57.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:57.539+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:57.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:57.667+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:58.525 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:58.524+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:58.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:58.717+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:59.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:25:59.529+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:25:59.691 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:25:59.691+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:00.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:00.544+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:00.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:00.703+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:01.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:01.511+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:01.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:01.692+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:02.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:02.465+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:02.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:02.727+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:03.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:03.427+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:03.732 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:03.731+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:04.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:04.389+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:04.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:04.716+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:05.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:05.346+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:05.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:05.723+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:06.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:06.307+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:06.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:06.729+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:07.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:07.320+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:07.737 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:07.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:08.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:08.303+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:08.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:08.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:09.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:09.339+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:09.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:09.711+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:10.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:10.307+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:10.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:10.735+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:11.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:11.287+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:11.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:11.763+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:12.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:12.335+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:12.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:12.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:13.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:13.307+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:13.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:13.815+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:14.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:14.265+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:14.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:14.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:15.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:15.299+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:15.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:15.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:16.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:16.349+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:16.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:16.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:17.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:17.368+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:17.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:17.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:18.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:18.363+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:18.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:18.951+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:19.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:19.369+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:19.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:19.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:20.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:20.388+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:20.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:20.981+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:21.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:21.437+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:21.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:21.959+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:22.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:22.485+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:23.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:23.005+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:23.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:23.521+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:24.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:24.015+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:24.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:24.565+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:25.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:25.001+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:25.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:25.605+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:25.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:25.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:26.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:26.583+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:26.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:26.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:27.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:27.554+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:27.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:27.951+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:28.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:28.599+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:28.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:28.933+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:29.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:29.582+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:29.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:29.948+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:30.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:30.573+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:30.920 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:30.919+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:31.610 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:31.609+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:31.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:31.915+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:32.578 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:32.577+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:32.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:32.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:33.610 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:33.610+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:33.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:33.988+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:34.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:34.586+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:35.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:35.013+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:35.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:35.592+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:36.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:36.017+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:36.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:36.584+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:37.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:37.042+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:37.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:37.557+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:38.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:38.040+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:38.575 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:38.575+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:39.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:39.045+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:39.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:39.614+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:40.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:40.048+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:40.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:40.599+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:41.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:41.096+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:41.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:41.607+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:42.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:42.109+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:42.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:42.603+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:43.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:43.077+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:43.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:43.575+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:44.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:44.063+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:44.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:44.605+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:45.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:45.017+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:45.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:45.563+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:45.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:45.987+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:46.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:46.579+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:46.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:46.943+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:47.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:47.567+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:47.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:47.961+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:48.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:48.539+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:48.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:48.945+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:49.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:49.535+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:49.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:49.965+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:50.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:50.585+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:50.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:50.957+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:51.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:51.627+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:51.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:51.931+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:52.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:52.658+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:52.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:52.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:53.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:53.631+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:53.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:53.907+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:54.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:54.607+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:54.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:54.930+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:55.610 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:55.609+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:55.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:55.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:56.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:56.628+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:56.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:56.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:57.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:57.639+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:57.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:57.961+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:58.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:58.682+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:58.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:58.965+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:59.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:26:59.720+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:26:59.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:26:59.951+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:00.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:00.716+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:00.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:00.945+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:01.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:01.667+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:01.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:01.972+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:02.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:02.655+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:03.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:03.001+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:03.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:03.664+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:03.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:03.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:04.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:04.640+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:05.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:05.045+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:05.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:05.651+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:06.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:06.041+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:06.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:06.639+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:07.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:07.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:07.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:07.662+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:08.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:08.023+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:08.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:08.627+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:09.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:09.029+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:09.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:09.668+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:10.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:10.066+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:10.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:10.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:11.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:11.115+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:11.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:11.669+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:12.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:12.075+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:12.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:12.681+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:13.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:13.074+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:13.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:13.692+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:14.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:14.079+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:14.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:14.723+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:15.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:15.089+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:15.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:15.761+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:16.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:16.071+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:16.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:16.803+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:17.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:17.025+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:17.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:17.816+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:18.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:18.067+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:18.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:18.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:19.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:19.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:19.777 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:19.777+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:20.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:20.052+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:20.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:20.783+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:21.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:21.074+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:21.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:21.771+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:22.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:22.031+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:22.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:22.783+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:22.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:22.990+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:23.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:23.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:24.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:24.015+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:24.807 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:24.807+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:24.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:24.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:25.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:25.857+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:26.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:26.000+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:26.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:26.879+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:27.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:26.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:27.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:27.837+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:28.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:28.022+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:28.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:28.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:29.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:29.031+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:29.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:29.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:29.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:29.982+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:30.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:30.744+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:30.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:30.998+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:31.758 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:31.758+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:31.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:31.978+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:32.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:32.714+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:32.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:32.959+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:33.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:33.722+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:33.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:33.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:34.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:34.720+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:34.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:34.956+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:35.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:35.759+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:36.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:35.999+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:36.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:36.802+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:37.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:37.023+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:37.793 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:37.792+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:38.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:38.030+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:38.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:38.804+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:39.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:39.041+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:39.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:39.803+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:40.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:40.059+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:40.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:40.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:41.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:41.083+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:41.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:41.782+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:42.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:42.102+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:42.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:42.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:43.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:43.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:43.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:43.771+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:44.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:44.057+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:44.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:44.735+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:45.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:45.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:45.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:45.729+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:46.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:46.046+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:46.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:46.766+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:47.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:47.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:47.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:47.760+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:48.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:48.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:48.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:48.809+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:49.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:49.091+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:49.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:49.850+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:50.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:50.052+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:50.827 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:50.826+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:51.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:51.075+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:51.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:51.838+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:52.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:52.112+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:52.869 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:52.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:53.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:53.118+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:53.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:53.838+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:54.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:54.075+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:54.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:54.800+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:55.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:55.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:55.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:55.817+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:56.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:56.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:56.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:56.856+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:57.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:57.046+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:57.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:57.898+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:58.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:58.080+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:58.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:58.865+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:59.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:27:59.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:27:59.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:27:59.825+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:00.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:00.031+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:00.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:00.808+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:01.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:01.068+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:01.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:01.808+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:02.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:02.040+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:02.805 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:02.804+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:03.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:03.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:03.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:03.843+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:04.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:04.021+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:04.796 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:04.795+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:05.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:05.036+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:05.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:05.844+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:05.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:05.991+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:06.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:06.841+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:07.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:07.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:07.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:07.861+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:08.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:08.035+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:08.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:08.883+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:09.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:09.029+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:09.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:09.896+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:10.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:10.051+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:10.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:10.920+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:11.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:11.036+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:11.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:11.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:12.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:12.054+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:12.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:12.898+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:13.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:13.022+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:13.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:13.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:13.987 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:13.987+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:14.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:14.850+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:15.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:15.002+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:15.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:15.838+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:16.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:16.046+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:16.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:16.848+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:17.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:17.028+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:17.876 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:17.875+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:18.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:18.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:18.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:18.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:19.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:19.038+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:19.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:19.926+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:19.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:19.992+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:20.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:20.928+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:20.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:20.966+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:21.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:21.925+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:21.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:21.996+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:22.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:22.914+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:22.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:22.992+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:23.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:23.872+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:24.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:24.030+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:24.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:24.845+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:25.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:25.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:25.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:25.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:26.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:26.118+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:26.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:26.849+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:27.111 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:27.110+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:27.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:27.860+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:28.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:28.106+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:28.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:28.892+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:29.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:29.146+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:29.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:29.942+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:30.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:30.182+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:30.902 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:30.902+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:31.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:31.226+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:31.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:31.932+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:32.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:32.238+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:32.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:32.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:33.282 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:33.282+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:33.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:33.843+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:34.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:34.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:34.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:34.838+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:35.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:35.341+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:35.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:35.879+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:36.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:36.301+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:36.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:36.908+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:37.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:37.286+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:37.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:37.954+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:38.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:38.270+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:38.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:38.915+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:39.282 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:39.281+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:39.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:39.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:40.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:40.306+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:40.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:40.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:41.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:41.294+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:41.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:41.910+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:42.301 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:42.300+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:42.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:42.866+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:43.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:43.254+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:43.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:43.865+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:44.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:44.240+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:44.876 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:44.875+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:45.223 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:45.222+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:45.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:45.872+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:46.199 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:46.198+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:46.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:46.892+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:47.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:47.222+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:47.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:47.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:48.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:48.210+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:48.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:48.897+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:49.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:49.182+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:49.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:49.876+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:50.135 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:50.134+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:50.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:50.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:51.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:51.120+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:51.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:51.860+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:52.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:52.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:52.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:52.825+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:53.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:53.044+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:53.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:53.803+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:54.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:54.043+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:54.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:54.835+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:55.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:55.057+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:55.856 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:55.856+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:56.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:56.107+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:56.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:56.883+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:57.091 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:57.091+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:57.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:57.878+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:58.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:58.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:58.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:58.874+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:59.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:28:59.105+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:28:59.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:28:59.891+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:00.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:00.131+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:00.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:00.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:01.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:01.147+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:01.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:01.909+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:02.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:02.175+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:02.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:02.957+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:03.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:03.165+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:04.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:04.006+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:04.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:04.127+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:05.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:05.032+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:05.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:05.118+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:06.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:06.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:06.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:06.107+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:07.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:07.076+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:07.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:07.092+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:08.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:08.069+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:08.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:08.124+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:09.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:09.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:09.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:09.110+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:10.101 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:10.100+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:10.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:10.158+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:11.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:11.129+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:11.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:11.140+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:12.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:12.137+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:12.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:12.154+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:13.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:13.106+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:13.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:13.153+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:14.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:14.129+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:14.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:14.150+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:15.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:15.094+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:15.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:15.157+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:16.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:16.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:16.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:16.145+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:17.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:17.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:17.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:17.180+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:18.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:18.069+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:18.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:18.202+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:19.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:19.055+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:19.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:19.157+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:20.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:20.053+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:20.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:20.127+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:21.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:21.015+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:21.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:21.120+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:21.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:21.984+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:22.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:22.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:23.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:23.026+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:23.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:23.106+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:24.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:24.034+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:24.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:24.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:25.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:25.029+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:25.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:25.079+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:26.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:26.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:26.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:26.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:27.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:27.072+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:27.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:27.102+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:28.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:28.110+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:28.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:28.141+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:29.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:29.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:29.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:29.152+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:30.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:30.122+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:30.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:30.169+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:31.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:31.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:31.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:31.158+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:32.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:32.119+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:32.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:32.129+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:33.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:33.088+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:33.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:33.159+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:34.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:34.106+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:34.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:34.150+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:35.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:35.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:35.157 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:35.156+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:36.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:36.141+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:36.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:36.142+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:37.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:37.113+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:37.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:37.162+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:38.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:38.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:38.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:38.134+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:39.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:39.072+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:39.171 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:39.170+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:40.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:40.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:40.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:40.204+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:41.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:41.078+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:41.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:41.248+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:42.074 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:42.074+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:42.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:42.265+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:43.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:43.055+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:43.221 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:43.221+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:44.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:44.076+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:44.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:44.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:45.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:45.108+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:45.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:45.239+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:46.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:46.072+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:46.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:46.248+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:47.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:47.108+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:47.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:47.210+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:48.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:48.126+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:48.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:48.170+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:49.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:49.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:49.211 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:49.211+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:50.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:50.119+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:50.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:50.221+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:51.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:51.083+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:51.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:51.190+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:52.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:52.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:52.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:52.162+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:53.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:53.010+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:53.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:53.191+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:54.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:54.022+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:54.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:54.235+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:55.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:55.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:55.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:55.213+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:56.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:56.064+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:56.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:56.169+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:57.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:57.106+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:57.137 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:57.137+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:58.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:58.099+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:58.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:58.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:59.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:29:59.085+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:29:59.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:29:59.113+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:00.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:00.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:00.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:00.079+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:01.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:01.095+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:01.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:01.123+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:02.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:02.081+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:02.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:02.139+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:03.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:03.094+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:03.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:03.128+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:04.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:04.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:04.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:04.134+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:05.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:05.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:05.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:05.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:06.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:06.049+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:06.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:06.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:07.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:07.043+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:07.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:07.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:08.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:08.021+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:08.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:08.065+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:08.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:08.995+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:09.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:09.039+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:09.991 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:09.990+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:10.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:10.028+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:10.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:10.988+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:11.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:11.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:11.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:11.973+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:12.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:12.062+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:12.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:12.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:13.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:13.111+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:13.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:13.935+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:14.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:14.088+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:14.940 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:14.939+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:15.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:15.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:15.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:15.961+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:16.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:16.121+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:16.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:16.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:17.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:17.150+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:17.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:17.918+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:18.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:18.200+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:18.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:18.917+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:19.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:19.251+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:19.940 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:19.939+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:20.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:20.253+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:20.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:20.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:21.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:21.302+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:21.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:21.938+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:22.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:22.291+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:22.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:22.918+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:23.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:23.246+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:23.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:23.913+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:24.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:24.256+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:24.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:24.872+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:25.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:25.294+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:25.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:25.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:26.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:26.340+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:26.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:26.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:27.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:27.367+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:27.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:27.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:28.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:28.324+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:28.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:28.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:29.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:29.368+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:29.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:29.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:30.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:30.341+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:30.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:30.849+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:31.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:31.367+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:31.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:31.900+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:32.402 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:32.402+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:32.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:32.853+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:33.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:33.403+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:33.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:33.894+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:34.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:34.373+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:34.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:34.885+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:35.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:35.369+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:35.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:35.870+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:36.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:36.321+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:36.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:36.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:37.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:37.286+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:37.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:37.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:38.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:38.248+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:38.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:38.862+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:39.210 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:39.209+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:39.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:39.872+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:40.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:40.208+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:40.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:40.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:41.180 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:41.180+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:41.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:41.785+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:42.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:42.172+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:42.812 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:42.811+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:43.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:43.205+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:43.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:43.814+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:44.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:44.184+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:44.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:44.837+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:45.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:45.145+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:45.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:45.867+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:46.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:46.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:46.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:46.827+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:47.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:47.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:47.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:47.857+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:48.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:48.149+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:48.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:48.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:49.180 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:49.179+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:49.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:49.867+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:50.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:50.177+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:50.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:50.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:51.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:51.193+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:51.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:51.914+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:52.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:52.187+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:52.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:52.898+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:53.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:53.167+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:53.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:53.884+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:54.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:54.177+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:54.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:54.837+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:55.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:55.226+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:55.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:55.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:56.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:56.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:56.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:56.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:57.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:57.249+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:57.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:57.851+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:58.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:58.249+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:58.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:58.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:59.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:30:59.229+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:30:59.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:30:59.833+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:00.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:00.210+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:00.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:00.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:01.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:01.191+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:01.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:01.868+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:02.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:02.143+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:02.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:02.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:03.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:03.172+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:03.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:03.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:04.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:04.163+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:04.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:04.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:05.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:05.191+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:05.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:05.897+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:06.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:06.173+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:06.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:06.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:07.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:07.183+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:07.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:07.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:08.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:08.211+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:08.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:08.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:09.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:09.215+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:09.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:09.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:10.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:10.183+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:10.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:10.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:11.162 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:11.161+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:11.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:11.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:12.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:12.192+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:12.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:12.887+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:13.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:13.171+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:13.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:13.844+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:14.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:14.142+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:14.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:14.799+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:15.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:15.173+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:15.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:15.832+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:16.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:16.139+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:16.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:16.795+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:17.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:17.091+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:17.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:17.844+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:18.131 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:18.131+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:18.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:18.887+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:19.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:19.085+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:19.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:19.856+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:20.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:20.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:20.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:20.852+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:21.083 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:21.083+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:21.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:21.872+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:22.048 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:22.047+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:22.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:22.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:23.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:23.023+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:23.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:23.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:24.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:24.056+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:24.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:24.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:25.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:25.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:25.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:25.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:26.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:26.055+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:26.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:26.892+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:27.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:27.030+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:27.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:27.865+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:28.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:28.039+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:28.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:28.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:29.083 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:29.082+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:29.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:29.842+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:30.105 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:30.104+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:30.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:30.824+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:31.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:31.122+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:31.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:31.851+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:32.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:32.165+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:32.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:32.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:33.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:33.203+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:33.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:33.922+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:34.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:34.218+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:34.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:34.940+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:35.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:35.178+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:35.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:35.962+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:36.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:36.130+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:36.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:36.915+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:37.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:37.162+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:37.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:37.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:38.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:38.146+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:38.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:38.892+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:39.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:39.134+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:39.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:39.920+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:40.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:40.129+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:40.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:40.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:41.134 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:41.134+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:41.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:41.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:42.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:42.166+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:42.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:42.932+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:43.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:43.128+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:43.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:43.976+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:44.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:44.146+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:45.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:45.006+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:45.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:45.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:46.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:46.011+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:46.097 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:46.096+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:47.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:47.035+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:47.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:47.049+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:48.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:48.033+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:48.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:48.064+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:49.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:49.036+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:49.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:49.046+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:50.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:50.039+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:50.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:50.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:51.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:51.052+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:51.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:51.089+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:52.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:52.010+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:52.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:52.108+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:52.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:52.978+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:53.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:53.064+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:53.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:53.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:54.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:54.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:54.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:54.936+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:55.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:55.064+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:55.950 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:55.949+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:56.105 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:56.104+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:56.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:56.962+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:57.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:57.091+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:58.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:58.004+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:58.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:58.057+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:58.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:58.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:59.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:31:59.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:31:59.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:31:59.988+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:00.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:00.055+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:00.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:00.999+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:01.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:01.047+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:01.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:01.953+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:02.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:02.046+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:02.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:02.909+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:03.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:03.029+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:03.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:03.939+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:04.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:04.003+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:04.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:04.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:04.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:04.987+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:05.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:05.902+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:05.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:05.940+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:06.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:06.937+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:06.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:06.971+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:07.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:07.928+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:08.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:08.017+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:08.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:08.926+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:09.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:09.014+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:09.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:09.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:10.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:10.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:10.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:10.912+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:11.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:11.029+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:11.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:11.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:12.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:12.050+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:12.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:12.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:13.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:13.088+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:13.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:13.888+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:14.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:14.107+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:14.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:14.860+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:15.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:15.141+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:15.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:15.890+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:16.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:16.162+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:16.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:16.846+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:17.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:17.166+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:17.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:17.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:18.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:18.141+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:18.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:18.851+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:19.168 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:19.167+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:19.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:19.844+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:20.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:20.122+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:20.864 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:20.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:21.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:21.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:21.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:21.884+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:22.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:22.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:22.924 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:22.923+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:23.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:23.123+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:23.940 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:23.939+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:24.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:24.101+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:24.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:24.952+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:25.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:25.124+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:25.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:25.957+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:26.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:26.117+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:26.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:26.929+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:27.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:27.147+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:27.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:27.944+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:28.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:28.146+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:28.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:28.906+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:29.116 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:29.115+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:29.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:29.932+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:30.121 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:30.120+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:30.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:30.898+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:31.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:31.158+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:31.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:31.920+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:32.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:32.208+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:32.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:32.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:33.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:33.188+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:33.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:33.906+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:34.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:34.223+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:34.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:34.903+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:35.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:35.234+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:35.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:35.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:36.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:36.231+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:36.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:36.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:37.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:37.278+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:37.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:37.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:38.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:38.273+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:38.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:38.898+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:39.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:39.272+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:39.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:39.868+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:40.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:40.291+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:40.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:40.832+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:41.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:41.245+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:41.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:41.866+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:42.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:42.277+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:42.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:42.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:43.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:43.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:43.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:43.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:44.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:44.272+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:44.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:44.926+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:45.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:45.287+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:45.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:45.892+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:46.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:46.258+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:46.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:46.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:47.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:47.284+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:47.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:47.821+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:48.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:48.237+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:48.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:48.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:49.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:49.275+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:49.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:49.786+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:50.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:50.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:50.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:50.757+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:51.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:51.296+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:51.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:51.735+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:52.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:52.330+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:52.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:52.738+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:53.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:53.351+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:53.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:53.746+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:54.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:54.319+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:54.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:54.700+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:55.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:55.366+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:55.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:55.710+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:56.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:56.325+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:56.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:56.688+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:57.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:57.329+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:57.707 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:57.706+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:58.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:58.340+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:58.691 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:58.690+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:59.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:32:59.342+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:32:59.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:32:59.723+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:00.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:00.391+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:00.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:00.720+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:01.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:01.398+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:01.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:01.686+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:02.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:02.400+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:02.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:02.693+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:03.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:03.440+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:03.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:03.654+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:04.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:04.450+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:04.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:04.704+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:05.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:05.492+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:05.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:05.748+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:06.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:06.540+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:06.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:06.758+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:07.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:07.498+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:07.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:07.764+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:08.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:08.521+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:08.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:08.718+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:09.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:09.540+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:09.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:09.766+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:10.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:10.552+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:10.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:10.768+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:11.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:11.569+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:11.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:11.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:12.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:12.602+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:12.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:12.748+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:13.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:13.591+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:13.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:13.734+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:14.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:14.640+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:14.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:14.754+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:15.614 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:15.614+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:15.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:15.730+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:16.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:16.654+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:16.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:16.740+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:17.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:17.643+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:17.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:17.704+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:18.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:18.596+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:18.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:18.707+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:19.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:19.602+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:19.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:19.702+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:20.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:20.582+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:20.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:20.734+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:21.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:21.616+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:21.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:21.715+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:22.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:22.630+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:22.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:22.676+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:23.625 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:23.623+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:23.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:23.720+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:24.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:24.626+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:24.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:24.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:25.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:25.626+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:25.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:25.738+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:26.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:26.579+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:26.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:26.750+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:27.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:27.580+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:27.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:27.722+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:28.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:28.547+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:28.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:28.688+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:29.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:29.501+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:29.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:29.689+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:30.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:30.511+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:30.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:30.662+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:31.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:31.552+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:31.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:31.620+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:32.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:32.548+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:32.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:32.620+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:33.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:33.594+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:33.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:33.654+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:34.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:34.591+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:34.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:34.621+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:35.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:35.607+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:35.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:35.655+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:36.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:36.595+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:36.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:36.642+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:37.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:37.614+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:37.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:37.618+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:38.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:38.599+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:38.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:38.638+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:39.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:39.628+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:39.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:39.642+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:40.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:40.593+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:40.664 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:40.664+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:41.612 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:41.611+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:41.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:41.691+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:42.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:42.660+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:42.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:42.741+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:43.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:43.690+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:43.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:43.734+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:44.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:44.720+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:44.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:44.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:45.755 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:45.754+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:45.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:45.778+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:46.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:46.731+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:46.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:46.806+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:47.719 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:47.718+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:47.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:47.824+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:48.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:48.679+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:48.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:48.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:49.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:49.691+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:49.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:49.791+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:50.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:50.658+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:50.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:50.806+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:51.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:51.654+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:51.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:51.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:52.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:52.679+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:52.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:52.783+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:53.725 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:53.724+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:53.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:53.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:54.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:54.741+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:54.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:54.791+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:55.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:55.713+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:55.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:55.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:56.711 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:56.710+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:56.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:56.798+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:57.691 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:57.690+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:57.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:57.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:58.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:58.688+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:58.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:58.815+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:59.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:33:59.694+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:33:59.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:33:59.785+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:00.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:00.654+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:00.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:00.801+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:01.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:01.659+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:01.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:01.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:02.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:02.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:02.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:02.735+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:03.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:03.669+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:03.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:03.733+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:04.645 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:04.644+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:04.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:04.772+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:05.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:05.599+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:05.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:05.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:06.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:06.643+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:06.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:06.743+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:07.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:07.640+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:07.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:07.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:08.691 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:08.690+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:08.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:08.790+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:09.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:09.670+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:09.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:09.778+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:10.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:10.630+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:10.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:10.733+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:11.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:11.603+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:11.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:11.727+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:12.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:12.617+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:12.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:12.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:13.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:13.655+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:13.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:13.760+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:14.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:14.630+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:14.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:14.783+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:15.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:15.637+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:15.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:15.754+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:16.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:16.592+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:16.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:16.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:17.587 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:17.586+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:17.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:17.827+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:18.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:18.596+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:18.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:18.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:19.639 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:19.639+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:19.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:19.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:20.658 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:20.658+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:20.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:20.792+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:21.621 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:21.621+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:21.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:21.839+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:22.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:22.664+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:22.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:22.852+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:23.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:23.702+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:23.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:23.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:24.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:24.738+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:24.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:24.841+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:25.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:25.763+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:25.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:25.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:26.777 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:26.777+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:26.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:26.788+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:27.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:27.738+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:27.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:27.752+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:28.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:28.714+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:28.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:28.783+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:29.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:29.669+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:29.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:29.746+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:30.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:30.680+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:30.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:30.750+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:31.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:31.664+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:31.765 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:31.764+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:32.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:32.623+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:32.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:32.769+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:33.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:33.588+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:33.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:33.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:34.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:34.608+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:34.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:34.791+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:35.635 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:35.635+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:35.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:35.753+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:36.618 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:36.616+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:36.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:36.766+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:37.616 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:37.615+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:37.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:37.737+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:38.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:38.593+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:38.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:38.782+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:39.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:39.593+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:39.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:39.735+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:40.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:40.597+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:40.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:40.743+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:41.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:41.639+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:41.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:41.719+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:42.646 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:42.645+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:42.765 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:42.764+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:43.667 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:43.666+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:43.814 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:43.813+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:44.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:44.703+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:44.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:44.803+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:45.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:45.699+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:45.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:45.843+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:46.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:46.723+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:46.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:46.851+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:47.678 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:47.676+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:47.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:47.881+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:48.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:48.683+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:48.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:48.852+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:49.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:49.661+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:49.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:49.827+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:50.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:50.657+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:50.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:50.861+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:51.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:51.647+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:51.842 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:51.840+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:52.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:52.647+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:52.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:52.890+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:53.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:53.604+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:53.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:53.930+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:54.644 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:54.643+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:54.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:54.925+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:55.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:55.624+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:55.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:55.889+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:56.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:56.589+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:56.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:56.935+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:57.631 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:57.630+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:57.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:57.960+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:58.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:58.655+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:58.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:58.948+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:59.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:34:59.623+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:34:59.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:34:59.931+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:00.631 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:00.630+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:00.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:00.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:01.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:01.601+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:01.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:01.937+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:02.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:02.570+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:02.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:02.930+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:03.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:03.580+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:03.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:03.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:04.592 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:04.591+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:04.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:04.984+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:05.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:05.599+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:06.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:06.018+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:06.623 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:06.623+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:07.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:07.013+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:07.663 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:07.663+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:08.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:08.058+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:08.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:08.709+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:09.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:09.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:09.699 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:09.699+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:10.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:10.127+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:10.692 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:10.692+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:11.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:11.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:11.664 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:11.664+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:12.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:12.139+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:12.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:12.623+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:13.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:13.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:13.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:13.670+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:14.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:14.111+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:14.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:14.657+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:15.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:15.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:15.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:15.631+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:16.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:16.143+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:16.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:16.587+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:17.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:17.097+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:17.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:17.628+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:18.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:18.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:18.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:18.628+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:19.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:19.119+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:19.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:19.642+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:20.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:20.097+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:20.683 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:20.683+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:21.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:21.055+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:21.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:21.693+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:22.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:22.043+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:22.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:22.701+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:23.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:23.078+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:23.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:23.741+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:24.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:24.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:24.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:24.729+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:25.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:25.092+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:25.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:25.687+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:26.074 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:26.073+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:26.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:26.723+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:27.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:27.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:27.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:27.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:28.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:28.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:28.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:28.757+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:29.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:29.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:29.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:29.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:30.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:30.108+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:30.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:30.743+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:31.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:31.117+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:31.725 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:31.724+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:32.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:32.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:32.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:32.751+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:33.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:33.051+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:33.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:33.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:34.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:34.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:34.737 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:34.736+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:35.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:35.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:35.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:35.707+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:36.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:36.103+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:36.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:36.748+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:37.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:37.131+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:37.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:37.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:38.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:38.159+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:38.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:38.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:39.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:39.192+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:39.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:39.735+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:40.207 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:40.206+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:40.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:40.768+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:41.162 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:41.161+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:41.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:41.746+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:42.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:42.146+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:42.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:42.763+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:43.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:43.149+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:43.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:43.773+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:44.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:44.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:44.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:44.776+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:45.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:45.145+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:45.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:45.795+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:46.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:46.143+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:46.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:46.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:47.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:47.143+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:47.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:47.799+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:48.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:48.116+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:48.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:48.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:49.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:49.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:49.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:49.804+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:50.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:50.127+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:50.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:50.821+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:51.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:51.164+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:51.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:51.798+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:52.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:52.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:52.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:52.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:53.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:53.133+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:53.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:53.813+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:54.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:54.108+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:54.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:54.785+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:55.066 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:55.066+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:55.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:55.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:56.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:56.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:56.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:56.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:57.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:57.113+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:57.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:57.758+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:58.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:58.161+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:58.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:58.747+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:59.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:35:59.152+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:35:59.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:35:59.705+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:00.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:00.185+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:00.682 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:00.682+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:01.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:01.162+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:01.663 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:01.662+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:02.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:02.203+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:02.671 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:02.670+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:03.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:03.222+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:03.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:03.680+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:04.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:04.191+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:04.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:04.718+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:05.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:05.201+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:05.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:05.692+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:06.245 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:06.244+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:06.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:06.704+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:07.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:07.196+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:07.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:07.676+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:08.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:08.230+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:08.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:08.693+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:09.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:09.256+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:09.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:09.742+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:10.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:10.220+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:10.745 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:10.744+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:11.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:11.199+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:11.725 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:11.724+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:12.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:12.214+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:12.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:12.684+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:13.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:13.223+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:13.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:13.688+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:14.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:14.193+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:14.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:14.641+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:15.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:15.210+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:15.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:15.642+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:16.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:16.213+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:16.678 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:16.678+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:17.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:17.211+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:17.679 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:17.678+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:18.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:18.212+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:18.653 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:18.652+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:19.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:19.216+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:19.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:19.690+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:20.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:20.219+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:20.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:20.722+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:21.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:21.268+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:21.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:21.765+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:22.305 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:22.304+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:22.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:22.802+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:23.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:23.268+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:23.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:23.829+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:24.243 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:24.242+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:24.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:24.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:25.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:25.223+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:25.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:25.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:26.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:26.199+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:26.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:26.832+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:27.229 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:27.226+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:27.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:27.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:28.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:28.240+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:28.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:28.925+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:29.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:29.253+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:29.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:29.936+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:30.291 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:30.290+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:30.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:30.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:31.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:31.263+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:31.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:31.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:32.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:32.221+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:32.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:32.819+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:33.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:33.218+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:33.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:33.778+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:34.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:34.257+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:34.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:34.753+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:35.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:35.294+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:35.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:35.802+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:36.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:36.276+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:36.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:36.813+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:37.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:37.263+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:37.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:37.800+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:38.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:38.297+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:38.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:38.849+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:39.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:39.293+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:39.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:39.873+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:40.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:40.303+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:40.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:40.847+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:41.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:41.304+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:41.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:41.896+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:42.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:42.327+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:42.884 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:42.884+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:43.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:43.320+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:43.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:43.912+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:44.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:44.355+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:44.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:44.913+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:45.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:45.325+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:45.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:45.934+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:46.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:46.281+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:46.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:46.974+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:47.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:47.279+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:48.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:48.006+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:48.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:48.237+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:48.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:48.959+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:49.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:49.230+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:49.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:49.913+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:50.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:50.250+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:50.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:50.906+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:51.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:51.268+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:51.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:51.895+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:52.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:52.299+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:52.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:52.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:53.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:53.303+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:53.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:53.837+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:54.286 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:54.285+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:54.867 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:54.866+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:55.260 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:55.259+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:55.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:55.886+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:56.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:56.218+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:56.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:56.903+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:57.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:57.239+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:57.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:57.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:58.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:58.233+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:58.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:58.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:59.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:36:59.186+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:36:59.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:36:59.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:00.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:00.152+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:00.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:00.851+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:01.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:01.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:01.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:01.822+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:02.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:02.069+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:02.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:02.784+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:03.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:03.085+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:03.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:03.773+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:04.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:04.088+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:04.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:04.785+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:05.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:05.086+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:05.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:05.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:06.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:06.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:06.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:06.821+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:07.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:07.134+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:07.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:07.872+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:08.140 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:08.139+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:08.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:08.885+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:09.162 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:09.161+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:09.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:09.922+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:10.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:10.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:10.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:10.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:11.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:11.155+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:11.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:11.861+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:12.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:12.182+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:12.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:12.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:13.136 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:13.135+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:13.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:13.789+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:14.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:14.117+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:14.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:14.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:15.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:15.157+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:15.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:15.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:16.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:16.111+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:16.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:16.879+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:17.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:17.137+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:17.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:17.921+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:18.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:18.175+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:18.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:18.872+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:19.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:19.197+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:19.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:19.852+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:20.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:20.166+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:20.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:20.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:21.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:21.121+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:21.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:21.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:22.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:22.131+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:22.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:22.797+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:23.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:23.163+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:23.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:23.819+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:24.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:24.128+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:24.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:24.860+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:25.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:25.085+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:25.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:25.839+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:26.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:26.087+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:26.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:26.822+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:27.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:27.085+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:27.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:27.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:28.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:28.081+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:28.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:28.839+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:29.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:29.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:29.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:29.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:30.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:30.009+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:30.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:30.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:31.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:31.035+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:31.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:31.883+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:32.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:32.003+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:32.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:32.907+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:33.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:33.033+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:33.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:33.873+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:34.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:34.041+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:34.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:34.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:35.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:35.053+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:35.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:35.816+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:36.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:36.067+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:36.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:36.796+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:37.097 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:37.096+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:37.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:37.834+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:38.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:38.145+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:38.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:38.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:39.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:39.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:39.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:39.835+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:40.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:40.077+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:40.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:40.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:41.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:41.049+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:41.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:41.812+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:42.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:42.050+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:42.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:42.816+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:43.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:43.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:43.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:43.791+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:44.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:44.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:44.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:44.783+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:45.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:45.166+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:45.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:45.738+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:46.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:46.160+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:46.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:46.763+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:47.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:47.123+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:47.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:47.783+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:48.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:48.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:48.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:48.753+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:49.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:49.147+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:49.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:49.733+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:50.131 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:50.130+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:50.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:50.754+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:51.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:51.085+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:51.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:51.735+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:52.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:52.044+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:52.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:52.730+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:53.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:53.039+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:53.696 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:53.695+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:53.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:53.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:54.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:54.710+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:55.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:55.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:55.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:55.746+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:56.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:56.044+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:56.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:56.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:56.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:56.995+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:57.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:57.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:58.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:57.999+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:58.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:58.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:58.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:58.984+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:59.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:37:59.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:37:59.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:37:59.960+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:00.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:00.846+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:00.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:00.946+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:01.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:01.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:01.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:01.997+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:02.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:02.806+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:03.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:03.024+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:03.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:03.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:04.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:04.020+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:04.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:04.814+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:04.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:04.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:05.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:05.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:05.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:05.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:06.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:06.846+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:06.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:06.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:07.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:07.856+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:07.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:07.982+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:08.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:08.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:08.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:08.977+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:09.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:09.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:09.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:09.985+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:10.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:10.922+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:10.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:10.985+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:11.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:11.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:11.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:11.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:12.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:12.914+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:12.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:12.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:13.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:13.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:13.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:13.909+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:14.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:14.912+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:14.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:14.936+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:15.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:15.883+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:15.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:15.897+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:16.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:16.852+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:16.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:16.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:17.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:17.822+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:17.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:17.868+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:18.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:18.850+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:18.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:18.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:19.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:19.813+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:19.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:19.923+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:20.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:20.814+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:20.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:20.935+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:21.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:21.781+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:21.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:21.894+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:22.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:22.828+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:22.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:22.847+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:23.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:23.785+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:23.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:23.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:24.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:24.771+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:24.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:24.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:25.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:25.732+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:25.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:25.784+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:26.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:26.717+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:26.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:26.797+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:27.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:27.723+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:27.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:27.842+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:28.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:28.683+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:28.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:28.837+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:29.636 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:29.635+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:29.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:29.798+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:30.615 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:30.614+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:30.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:30.802+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:31.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:31.665+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:31.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:31.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:32.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:32.643+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:32.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:32.809+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:33.612 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:33.610+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:33.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:33.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:34.602 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:34.601+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:34.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:34.819+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:35.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:35.568+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:35.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:35.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:36.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:36.597+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:36.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:36.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:37.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:37.575+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:37.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:37.787+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:38.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:38.608+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:38.822 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:38.821+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:39.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:39.573+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:39.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:39.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:40.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:40.525+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:40.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:40.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:41.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:41.511+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:41.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:41.761+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:42.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:42.541+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:42.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:42.800+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:43.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:43.563+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:43.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:43.775+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:44.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:44.568+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:44.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:44.765+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:45.612 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:45.611+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:45.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:45.763+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:46.662 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:46.661+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:46.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:46.719+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:47.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:47.675+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:47.725 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:47.724+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:48.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:48.631+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:48.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:48.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:49.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:49.603+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:49.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:49.725+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:50.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:50.571+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:50.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:50.765+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:51.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:51.611+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:51.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:51.774+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:52.658 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:52.657+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:52.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:52.751+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:53.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:53.631+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:53.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:53.783+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:54.650 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:54.649+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:54.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:54.804+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:55.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:55.684+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:55.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:55.757+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:56.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:56.694+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:56.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:56.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:57.728 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:57.728+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:57.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:57.794+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:58.696 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:58.695+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:58.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:58.762+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:59.649 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:38:59.649+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:38:59.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:38:59.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:00.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:00.608+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:00.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:00.753+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:01.588 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:01.587+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:01.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:01.717+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:02.587 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:02.587+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:02.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:02.676+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:03.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:03.560+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:03.669 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:03.669+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:04.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:04.604+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:04.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:04.668+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:05.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:05.634+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:05.661 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:05.661+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:06.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:06.622+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:06.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:06.626+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:07.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:07.593+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:07.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:07.648+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:08.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:08.568+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:08.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:08.669+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:09.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:09.553+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:09.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:09.637+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:10.528 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:10.527+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:10.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:10.600+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:11.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:11.504+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:11.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:11.588+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:12.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:12.549+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:12.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:12.585+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:13.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:13.579+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:13.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:13.609+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:14.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:14.545+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:14.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:14.584+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:15.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:15.564+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:15.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:15.582+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:16.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:16.515+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:16.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:16.537+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:17.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:17.470+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:17.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:17.507+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:18.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:18.461+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:18.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:18.515+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:19.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:19.487+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:19.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:19.513+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:20.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:20.487+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:20.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:20.512+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:21.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:21.503+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:21.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:21.507+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:22.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:22.484+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:22.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:22.511+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:23.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:23.464+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:23.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:23.469+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:24.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:24.439+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:24.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:24.483+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:25.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:25.487+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:25.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:25.491+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:26.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:26.464+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:26.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:26.533+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:27.424 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:27.423+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:27.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:27.517+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:28.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:28.465+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:28.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:28.548+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:29.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:29.487+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:29.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:29.583+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:30.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:30.528+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:30.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:30.632+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:31.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:31.552+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:31.663 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:31.662+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:32.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:32.553+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:32.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:32.636+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:33.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:33.539+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:33.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:33.655+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:34.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:34.541+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:34.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:34.693+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:35.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:35.573+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:35.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:35.717+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:36.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:36.545+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:36.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:36.728+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:37.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:37.505+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:37.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:37.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:38.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:38.494+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:38.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:38.758+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:39.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:39.469+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:39.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:39.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:40.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:40.488+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:40.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:40.774+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:41.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:41.449+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:41.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:41.751+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:42.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:42.475+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:42.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:42.773+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:43.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:43.488+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:43.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:43.796+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:44.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:44.507+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:44.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:44.780+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:45.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:45.557+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:45.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:45.756+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:46.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:46.606+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:46.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:46.789+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:47.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:47.560+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:47.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:47.824+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:48.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:48.551+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:48.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:48.801+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:49.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:49.593+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:49.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:49.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:50.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:50.548+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:50.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:50.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:51.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:51.541+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:51.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:51.781+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:52.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:52.529+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:52.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:52.809+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:53.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:53.557+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:53.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:53.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:54.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:54.597+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:54.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:54.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:55.623 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:55.622+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:55.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:55.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:56.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:56.596+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:56.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:56.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:57.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:57.560+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:57.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:57.952+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:58.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:58.551+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:58.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:58.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:59.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:39:59.536+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:39:59.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:39:59.922+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:00.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:00.550+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:00.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:00.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:01.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:01.539+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:01.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:01.944+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:02.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:02.531+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:02.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:02.961+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:03.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:03.496+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:03.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:03.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:04.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:04.494+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:04.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:04.901+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:05.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:05.498+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:05.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:05.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:06.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:06.492+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:06.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:06.904+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:07.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:07.482+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:07.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:07.868+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:08.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:08.492+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:08.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:08.844+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:09.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:09.510+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:09.867 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:09.866+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:10.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:10.515+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:10.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:10.917+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:11.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:11.543+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:11.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:11.932+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:12.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:12.495+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:12.920 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:12.919+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:13.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:13.528+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:13.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:13.906+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:14.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:14.509+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:14.950 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:14.949+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:15.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:15.555+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:15.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:15.971+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:16.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:16.508+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:16.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:16.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:17.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:17.552+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:17.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:17.975+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:18.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:18.533+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:19.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:19.013+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:19.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:19.528+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:20.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:20.051+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:20.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:20.496+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:21.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:21.022+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:21.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:21.545+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:21.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:21.976+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:22.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:22.518+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:23.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:23.022+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:23.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:23.469+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:24.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:24.028+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:24.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:24.442+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:25.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:25.002+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:25.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:25.464+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:25.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:25.998+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:26.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:26.478+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:26.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:26.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:27.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:27.477+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:27.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:27.932+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:28.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:28.518+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:28.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:28.960+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:29.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:29.482+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:29.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:29.985+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:30.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:30.461+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:31.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:31.030+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:31.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:31.474+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:31.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:31.996+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:32.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:32.498+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:33.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:33.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:33.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:33.512+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:33.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:33.982+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:34.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:34.492+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:35.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:35.022+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:35.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:35.494+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:36.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:36.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:36.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:36.450+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:37.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:37.024+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:37.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:37.408+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:38.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:38.028+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:38.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:38.444+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:39.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:39.024+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:39.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:39.436+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:40.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:40.072+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:40.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:40.441+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:41.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:41.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:41.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:41.478+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:42.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:42.033+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:42.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:42.467+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:43.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:43.079+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:43.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:43.509+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:44.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:44.093+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:44.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:44.558+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:45.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:45.069+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:45.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:45.591+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:46.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:46.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:46.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:46.592+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:47.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:47.115+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:47.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:47.585+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:48.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:48.074+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:48.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:48.633+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:49.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:49.051+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:49.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:49.679+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:50.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:50.067+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:50.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:50.689+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:51.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:51.059+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:51.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:51.733+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:52.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:52.025+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:52.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:52.685+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:53.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:53.020+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:53.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:53.703+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:54.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:54.033+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:54.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:54.686+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:55.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:55.060+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:55.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:55.735+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:56.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:56.057+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:56.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:56.747+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:57.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:57.085+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:57.775 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:57.774+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:58.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:58.113+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:58.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:58.771+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:59.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:40:59.078+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:40:59.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:40:59.768+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:00.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:00.034+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:00.810 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:00.809+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:01.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:01.063+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:01.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:01.831+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:02.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:02.051+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:02.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:02.866+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:03.020 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:03.019+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:03.876 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:03.875+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:03.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:03.993+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:04.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:04.906+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:04.950 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:04.949+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:05.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:05.931+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:05.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:05.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:06.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:06.975+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:07.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:07.002+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:07.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:07.957+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:08.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:08.016+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:08.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:08.981+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:09.048 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:09.047+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:09.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:09.965+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:10.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:10.019+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:10.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:10.987+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:11.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:11.030+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:11.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:11.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:11.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:11.985+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:12.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:12.972+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:13.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:13.013+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:13.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:13.930+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:14.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:14.001+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:14.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:14.955+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:14.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:14.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:15.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:15.947+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:15.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:15.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:16.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:16.933+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:16.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:16.947+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:17.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:17.906+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:17.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:17.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:18.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:18.906+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:18.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:18.921+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:19.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:19.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:19.959 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:19.959+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:20.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:20.873+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:20.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:20.937+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:21.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:21.877+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:21.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:21.967+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:22.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:22.835+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:22.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:22.986+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:23.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:23.841+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:24.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:24.025+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:24.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:24.801+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:25.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:25.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:25.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:25.819+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:26.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:26.104+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:26.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:26.812+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:27.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:27.119+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:27.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:27.767+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:28.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:28.095+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:28.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:28.747+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:29.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:29.108+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:29.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:29.746+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:30.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:30.075+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:30.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:30.786+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:31.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:31.048+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:31.824 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:31.823+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:32.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:32.053+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:32.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:32.807+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:33.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:33.103+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:33.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:33.811+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:34.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:34.088+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:34.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:34.805+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:35.129 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:35.128+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:35.775 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:35.774+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:36.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:36.154+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:36.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:36.763+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:37.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:37.108+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:37.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:37.769+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:38.082 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:38.081+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:38.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:38.772+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:39.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:39.120+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:39.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:39.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:40.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:40.088+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:40.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:40.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:41.136 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:41.135+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:41.795 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:41.794+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:42.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:42.118+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:42.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:42.821+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:43.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:43.078+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:43.781 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:43.780+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:44.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:44.058+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:44.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:44.812+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:45.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:45.027+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:45.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:45.828+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:45.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:45.985+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:46.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:46.866+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:47.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:47.005+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:47.881 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:47.880+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:47.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:47.980+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:48.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:48.892+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:49.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:49.026+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:49.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:49.914+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:49.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:49.992+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:50.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:50.933+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:51.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:51.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:51.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:51.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:51.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:51.984+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:52.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:52.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:53.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:53.000+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:53.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:53.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:54.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:54.012+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:54.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:54.860+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:55.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:55.016+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:55.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:55.862+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:55.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:55.994+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:56.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:56.844+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:56.987 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:56.986+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:57.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:57.852+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:57.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:57.991+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:58.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:58.821+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:58.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:58.984+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:59.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:41:59.860+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:41:59.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:41:59.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:00.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:00.864+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:00.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:00.918+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:01.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:01.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:01.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:01.940+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:02.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:02.886+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:02.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:02.915+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:03.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:03.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:03.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:03.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:04.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:04.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:04.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:04.882+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:05.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:05.841+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:05.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:05.867+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:06.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:06.879+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:06.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:06.890+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:07.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:07.904+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:07.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:07.922+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:08.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:08.865+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:08.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:08.904+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:09.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:09.866+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:09.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:09.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:10.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:10.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:10.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:10.892+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:11.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:11.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:11.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:11.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:12.822 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:12.822+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:12.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:12.903+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:13.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:13.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:13.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:13.954+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:14.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:14.792+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:14.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:14.978+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:15.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:15.746+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:15.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:15.961+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:16.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:16.774+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:16.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:16.953+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:17.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:17.787+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:17.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:17.947+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:18.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:18.769+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:18.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:18.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:19.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:19.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:19.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:19.959+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:20.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:20.764+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:20.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:20.927+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:21.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:21.726+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:21.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:21.949+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:22.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:22.721+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:22.902 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:22.901+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:23.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:23.697+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:23.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:23.873+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:24.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:24.689+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:24.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:24.853+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:25.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:25.661+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:25.820 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:25.819+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:26.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:26.708+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:26.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:26.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:27.732 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:27.731+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:27.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:27.740+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:28.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:28.697+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:28.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:28.775+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:29.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:29.737+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:29.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:29.755+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:30.697 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:30.696+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:30.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:30.766+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:31.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:31.694+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:31.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:31.812+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:32.654 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:32.653+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:32.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:32.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:33.605 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:33.604+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:33.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:33.816+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:34.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:34.602+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:34.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:34.783+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:35.578 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:35.577+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:35.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:35.797+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:36.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:36.616+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:36.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:36.834+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:37.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:37.621+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:37.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:37.873+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:38.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:38.597+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:38.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:38.897+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:39.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:39.585+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:39.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:39.895+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:40.566 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:40.565+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:40.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:40.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:41.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:41.597+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:41.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:41.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:42.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:42.620+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:42.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:42.865+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:43.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:43.645+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:43.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:43.853+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:44.648 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:44.647+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:44.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:44.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:45.602 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:45.601+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:45.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:45.867+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:46.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:46.615+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:46.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:46.901+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:47.568 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:47.567+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:47.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:47.870+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:48.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:48.607+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:48.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:48.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:49.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:49.594+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:49.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:49.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:50.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:50.564+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:50.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:50.924+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:51.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:51.545+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:51.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:51.954+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:52.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:52.504+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:53.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:53.000+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:53.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:53.466+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:53.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:53.998+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:54.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:54.517+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:54.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:54.972+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:55.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:55.555+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:56.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:56.021+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:56.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:56.516+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:56.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:56.997+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:57.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:57.492+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:57.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:57.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:58.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:58.534+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:58.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:58.933+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:59.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:42:59.544+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:42:59.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:42:59.952+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:00.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:00.544+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:00.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:00.930+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:01.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:01.529+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:01.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:01.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:02.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:02.515+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:02.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:02.843+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:03.477 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:03.476+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:03.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:03.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:04.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:04.479+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:04.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:04.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:05.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:05.489+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:05.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:05.789+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:06.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:06.474+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:06.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:06.747+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:07.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:07.519+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:07.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:07.714+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:08.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:08.517+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:08.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:08.763+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:09.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:09.523+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:09.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:09.745+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:10.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:10.523+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:10.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:10.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:11.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:11.475+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:11.789 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:11.788+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:12.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:12.486+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:12.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:12.751+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:13.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:13.506+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:13.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:13.783+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:14.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:14.553+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:14.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:14.822+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:15.568 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:15.567+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:15.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:15.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:16.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:16.535+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:16.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:16.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:17.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:17.547+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:17.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:17.797+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:18.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:18.537+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:18.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:18.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:19.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:19.543+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:19.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:19.861+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:20.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:20.555+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:20.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:20.888+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:21.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:21.525+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:21.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:21.887+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:22.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:22.481+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:22.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:22.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:23.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:23.509+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:23.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:23.923+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:24.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:24.501+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:24.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:24.902+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:25.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:25.465+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:25.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:25.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:26.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:26.417+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:26.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:26.892+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:27.454 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:27.453+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:27.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:27.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:28.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:28.496+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:28.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:28.849+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:29.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:29.504+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:29.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:29.815+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:30.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:30.521+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:30.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:30.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:31.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:31.515+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:31.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:31.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:32.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:32.511+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:32.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:32.841+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:33.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:33.485+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:33.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:33.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:34.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:34.509+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:34.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:34.902+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:35.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:35.518+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:35.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:35.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:36.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:36.533+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:36.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:36.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:37.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:37.563+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:37.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:37.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:38.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:38.563+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:38.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:38.926+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:39.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:39.560+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:39.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:39.952+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:40.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:40.585+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:40.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:40.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:41.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:41.544+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:41.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:41.951+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:42.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:42.504+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:42.940 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:42.940+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:43.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:43.543+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:43.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:43.944+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:44.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:44.592+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:44.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:44.971+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:45.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:45.549+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:45.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:45.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:46.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:46.599+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:46.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:46.985+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:47.605 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:47.605+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:48.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:48.032+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:48.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:48.571+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:49.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:49.005+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:49.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:49.585+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:49.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:49.997+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:50.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:50.603+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:51.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:51.020+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:51.590 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:51.589+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:52.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:52.029+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:52.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:52.581+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:53.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:53.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:53.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:53.580+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:54.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:53.987+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:54.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:54.630+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:54.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:54.943+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:55.610 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:55.609+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:55.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:55.979+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:56.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:56.654+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:56.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:56.933+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:57.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:57.691+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:57.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:57.925+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:58.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:58.731+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:58.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:58.937+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:59.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:43:59.781+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:43:59.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:43:59.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:00.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:00.803+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:00.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:00.895+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:01.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:01.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:01.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:01.861+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:02.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:02.786+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:02.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:02.897+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:03.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:03.741+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:03.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:03.885+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:04.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:04.749+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:04.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:04.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:05.728 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:05.727+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:05.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:05.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:06.697 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:06.696+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:06.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:06.887+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:07.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:07.682+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:07.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:07.914+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:08.645 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:08.644+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:08.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:08.944+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:09.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:09.633+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:09.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:09.915+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:10.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:10.631+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:10.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:10.895+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:11.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:11.669+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:11.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:11.879+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:12.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:12.642+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:12.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:12.834+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:13.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:13.693+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:13.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:13.853+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:14.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:14.667+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:14.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:14.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:15.701 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:15.700+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:15.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:15.889+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:16.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:16.740+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:16.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:16.885+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:17.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:17.740+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:17.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:17.920+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:18.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:18.758+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:18.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:18.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:19.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:19.728+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:19.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:19.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:20.769 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:20.768+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:20.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:20.903+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:21.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:21.737+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:21.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:21.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:22.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:22.783+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:22.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:22.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:23.755 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:23.754+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:23.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:23.868+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:24.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:24.725+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:24.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:24.840+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:25.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:25.770+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:25.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:25.865+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:26.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:26.722+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:26.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:26.835+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:27.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:27.746+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:27.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:27.814+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:28.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:28.722+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:28.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:28.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:29.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:29.702+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:29.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:29.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:30.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:30.682+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:30.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:30.862+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:31.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:31.676+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:31.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:31.820+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:32.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:32.702+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:32.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:32.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:33.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:33.718+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:33.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:33.809+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:34.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:34.680+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:34.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:34.852+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:35.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:35.721+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:35.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:35.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:36.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:36.752+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:36.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:36.793+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:37.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:37.756+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:37.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:37.781+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:38.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:38.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:38.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:38.811+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:39.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:39.754+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:39.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:39.827+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:40.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:40.770+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:40.842 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:40.841+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:41.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:41.727+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:41.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:41.793+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:42.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:42.720+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:42.820 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:42.819+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:43.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:43.715+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:43.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:43.778+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:44.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:44.741+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:44.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:44.824+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:45.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:45.765+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:45.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:45.791+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:46.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:46.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:46.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:46.807+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:47.787 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:47.786+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:47.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:47.851+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:48.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:48.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:48.830 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:48.829+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:49.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:49.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:49.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:49.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:50.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:50.761+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:50.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:50.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:51.769 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:51.767+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:51.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:51.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:52.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:52.763+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:52.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:52.769+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:53.716 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:53.715+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:53.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:53.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:54.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:54.705+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:54.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:54.813+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:55.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:55.727+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:55.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:55.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:56.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:56.744+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:56.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:56.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:57.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:57.778+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:57.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:57.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:58.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:58.745+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:58.834 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:58.833+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:59.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:44:59.743+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:44:59.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:44:59.802+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:00.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:00.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:00.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:00.788+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:01.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:01.801+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:01.824 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:01.823+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:02.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:02.785+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:02.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:02.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:03.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:03.788+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:03.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:03.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:04.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:04.769+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:04.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:04.837+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:05.796 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:05.794+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:05.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:05.804+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:06.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:06.758+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:06.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:06.840+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:07.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:07.713+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:07.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:07.871+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:08.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:08.746+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:08.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:08.865+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:09.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:09.711+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:09.860 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:09.859+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:10.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:10.693+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:10.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:10.872+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:11.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:11.686+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:11.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:11.886+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:12.671 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:12.671+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:12.881 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:12.881+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:13.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:13.694+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:13.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:13.899+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:14.652 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:14.652+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:14.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:14.890+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:15.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:15.622+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:15.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:15.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:16.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:16.579+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:16.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:16.937+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:17.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:17.540+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:17.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:17.973+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:18.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:18.517+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:19.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:19.012+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:19.482 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:19.481+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:20.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:20.017+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:20.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:20.481+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:20.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:20.982+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:21.475 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:21.475+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:22.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:22.008+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:22.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:22.490+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:22.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:22.984+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:23.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:23.496+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:23.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:23.953+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:24.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:24.487+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:24.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:24.998+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:25.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:25.444+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:26.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:26.020+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:26.414 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:26.413+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:27.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:27.056+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:27.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:27.385+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:28.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:28.050+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:28.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:28.338+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:29.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:29.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:29.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:29.362+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:30.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:30.132+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:30.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:30.314+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:31.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:31.174+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:31.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:31.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:32.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:32.204+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:32.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:32.402+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:33.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:33.170+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:33.390 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:33.388+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:34.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:34.140+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:34.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:34.423+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:35.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:35.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:35.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:35.414+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:36.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:36.070+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:36.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:36.457+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:37.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:37.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:37.501 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:37.500+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:38.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:38.056+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:38.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:38.532+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:39.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:39.086+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:39.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:39.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:40.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:40.085+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:40.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:40.491+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:41.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:41.036+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:41.515 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:41.514+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:42.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:42.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:42.466 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:42.465+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:43.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:43.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:43.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:43.453+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:44.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:44.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:44.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:44.466+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:45.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:45.105+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:45.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:45.496+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:46.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:46.126+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:46.479 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:46.478+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:47.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:47.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:47.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:47.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:48.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:48.084+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:48.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:48.494+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:49.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:49.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:49.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:49.529+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:50.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:50.084+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:50.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:50.490+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:51.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:51.132+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:51.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:51.497+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:52.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:52.101+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:52.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:52.511+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:53.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:53.056+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:53.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:53.539+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:54.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:54.061+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:54.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:54.512+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:55.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:55.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:55.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:55.542+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:56.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:56.044+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:56.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:56.580+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:57.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:57.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:57.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:57.563+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:58.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:58.022+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:58.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:58.609+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:59.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:58.973+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:59.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:45:59.579+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:45:59.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:45:59.966+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:00.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:00.613+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:00.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:00.987+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:01.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:01.634+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:01.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:01.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:02.661 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:02.661+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:02.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:02.962+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:03.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:03.617+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:03.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:03.933+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:04.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:04.586+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:04.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:04.909+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:05.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:05.546+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:05.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:05.933+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:06.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:06.583+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:06.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:06.907+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:07.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:07.539+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:07.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:07.865+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:08.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:08.549+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:08.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:08.872+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:09.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:09.594+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:09.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:09.850+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:10.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:10.547+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:10.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:10.865+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:11.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:11.586+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:11.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:11.889+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:12.555 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:12.554+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:12.871 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:12.870+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:13.506 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:13.505+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:13.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:13.848+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:14.479 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:14.478+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:14.811 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:14.809+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:15.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:15.512+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:15.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:15.842+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:16.485 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:16.483+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:16.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:16.846+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:17.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:17.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:17.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:17.884+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:18.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:18.528+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:18.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:18.849+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:19.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:19.488+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:19.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:19.899+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:20.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:20.512+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:20.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:20.874+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:21.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:21.532+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:21.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:21.876+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:22.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:22.566+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:22.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:22.909+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:23.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:23.584+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:23.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:23.924+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:24.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:24.548+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:24.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:24.970+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:25.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:25.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:25.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:25.969+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:26.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:26.507+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:26.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:26.943+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:27.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:27.535+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:27.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:27.956+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:28.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:28.501+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:28.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:28.978+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:29.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:29.550+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:29.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:29.994+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:30.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:30.560+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:30.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:30.960+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:31.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:31.588+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:31.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:31.932+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:32.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:32.625+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:32.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:32.957+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:33.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:33.586+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:33.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:33.936+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:34.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:34.595+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:34.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:34.922+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:35.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:35.547+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:35.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:35.924+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:36.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:36.526+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:36.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:36.964+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:37.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:37.486+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:37.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:37.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:38.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:38.462+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:38.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:38.922+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:39.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:39.460+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:39.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:39.933+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:40.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:40.494+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:40.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:40.944+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:41.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:41.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:41.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:41.929+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:42.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:42.533+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:42.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:42.912+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:43.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:43.567+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:43.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:43.910+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:44.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:44.557+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:44.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:44.890+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:45.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:45.579+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:45.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:45.892+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:46.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:46.612+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:46.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:46.941+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:47.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:47.611+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:47.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:47.926+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:48.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:48.579+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:48.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:48.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:49.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:49.602+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:49.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:49.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:50.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:50.585+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:50.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:50.852+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:51.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:51.540+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:51.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:51.862+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:52.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:52.581+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:52.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:52.828+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:53.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:53.536+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:53.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:53.828+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:54.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:54.578+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:54.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:54.801+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:55.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:55.576+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:55.810 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:55.809+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:56.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:56.625+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:56.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:56.791+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:57.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:57.624+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:57.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:57.775+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:58.664 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:58.663+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:58.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:58.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:59.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:46:59.655+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:46:59.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:46:59.784+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:00.665 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:00.664+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:00.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:00.749+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:01.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:01.700+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:01.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:01.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:02.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:02.655+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:02.731 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:02.730+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:03.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:03.687+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:03.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:03.769+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:04.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:04.660+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:04.733 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:04.732+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:05.710 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:05.709+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:05.735 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:05.735+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:06.682 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:06.681+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:06.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:06.782+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:07.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:07.684+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:07.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:07.815+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:08.696 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:08.695+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:08.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:08.852+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:09.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:09.713+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:09.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:09.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:10.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:10.718+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:10.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:10.863+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:11.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:11.719+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:11.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:11.911+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:12.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:12.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:12.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:12.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:13.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:13.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:13.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:13.899+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:14.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:14.824+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:14.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:14.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:15.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:15.853+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:15.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:15.857+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:16.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:16.849+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:16.902 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:16.901+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:17.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:17.853+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:17.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:17.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:18.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:18.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:18.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:18.896+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:19.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:19.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:19.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:19.853+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:20.824 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:20.823+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:20.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:20.864+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:21.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:21.779+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:21.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:21.871+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:22.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:22.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:22.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:22.825+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:23.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:23.816+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:23.840 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:23.839+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:24.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:24.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:24.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:24.873+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:25.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:25.852+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:25.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:25.867+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:26.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:26.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:26.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:26.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:27.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:27.867+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:28.314 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:27.878+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:28.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:28.871+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:28.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:28.879+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:29.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:29.851+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:29.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:29.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:30.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:30.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:30.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:30.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:31.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:31.787+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:31.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:31.881+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:32.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:32.804+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:32.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:32.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:33.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:33.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:33.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:33.907+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:34.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:34.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:34.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:34.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:35.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:35.803+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:35.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:35.917+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:36.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:36.841+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:36.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:36.893+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:37.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:37.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:37.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:37.898+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:38.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:38.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:38.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:38.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:39.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:39.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:39.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:39.937+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:40.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:40.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:40.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:40.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:41.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:41.885+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:41.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:41.946+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:42.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:42.861+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:42.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:42.919+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:43.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:43.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:43.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:43.952+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:44.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:44.917+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:44.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:44.920+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:45.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:45.954+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:45.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:45.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:46.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:46.908+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:46.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:46.915+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:47.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:47.893+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:47.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:47.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:48.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:48.845+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:48.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:48.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:49.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:49.850+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:49.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:49.892+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:50.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:50.864+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:50.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:50.891+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:51.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:51.903+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:51.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:51.932+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:52.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:52.883+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:52.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:52.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:53.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:53.886+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:53.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:53.912+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:54.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:54.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:54.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:54.899+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:55.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:55.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:55.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:55.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:56.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:56.847+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:56.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:56.904+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:57.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:57.808+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:57.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:57.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:58.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:58.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:58.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:58.902+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:59.869 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:47:59.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:47:59.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:47:59.893+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:00.827 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:00.826+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:00.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:00.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:01.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:01.828+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:01.983 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:01.982+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:02.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:02.808+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:03.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:03.016+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:03.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:03.766+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:04.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:04.042+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:04.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:04.755+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:05.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:05.093+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:05.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:05.733+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:06.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:06.139+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:06.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:06.704+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:07.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:07.152+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:07.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:07.702+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:08.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:08.106+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:08.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:08.664+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:09.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:09.122+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:09.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:09.680+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:10.101 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:10.100+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:10.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:10.708+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:11.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:11.094+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:11.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:11.698+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:12.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:12.096+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:12.707 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:12.706+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:13.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:13.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:13.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:13.691+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:14.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:14.094+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:14.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:14.698+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:15.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:15.047+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:15.719 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:15.718+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:16.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:16.064+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:16.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:16.766+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:17.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:17.105+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:17.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:17.796+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:18.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:18.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:18.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:18.756+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:19.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:19.060+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:19.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:19.802+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:20.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:20.026+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:20.831 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:20.831+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:20.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:20.978+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:21.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:21.845+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:21.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:21.973+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:22.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:22.879+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:22.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:22.969+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:23.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:23.922+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:23.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:23.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:24.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:24.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:24.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:24.962+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:25.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:25.945+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:25.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:25.971+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:26.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:26.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:26.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:26.925+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:27.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:27.941+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:27.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:27.943+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:28.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:28.957+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:28.991 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:28.990+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:29.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:29.996+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:30.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:30.024+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:30.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:30.966+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:31.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:31.068+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:31.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:31.924+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:32.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:32.068+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:32.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:32.972+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:33.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:33.075+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:34.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:34.021+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:34.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:34.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:34.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:34.982+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:35.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:35.060+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:36.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:36.014+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:36.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:36.079+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:37.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:37.003+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:37.122 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:37.121+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:38.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:38.032+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:38.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:38.155+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:38.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:38.987+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:39.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:39.169+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:39.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:39.944+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:40.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:40.204+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:40.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:40.939+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:41.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:41.245+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:41.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:41.944+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:42.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:42.262+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:42.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:42.902+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:43.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:43.267+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:43.881 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:43.880+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:44.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:44.294+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:44.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:44.918+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:45.291 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:45.290+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:45.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:45.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:46.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:46.331+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:46.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:46.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:47.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:47.350+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:47.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:47.941+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:48.337 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:48.336+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:48.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:48.929+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:49.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:49.292+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:49.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:49.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:50.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:50.243+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:50.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:50.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:51.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:51.256+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:51.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:51.890+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:52.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:52.289+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:52.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:52.891+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:53.319 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:53.318+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:53.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:53.912+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:54.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:54.334+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:54.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:54.890+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:55.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:55.363+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:55.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:55.929+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:56.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:56.326+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:56.939 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:56.938+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:57.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:57.310+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:57.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:57.953+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:58.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:58.332+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:58.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:48:58.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:48:59.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:48:59.350+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:00.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:00.011+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:00.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:00.359+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:01.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:01.000+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:01.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:01.394+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:01.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:01.979+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:02.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:02.360+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:03.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:03.028+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:03.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:03.360+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:04.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:04.002+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:04.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:04.322+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:05.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:05.050+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:05.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:05.358+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:06.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:06.012+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:06.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:06.353+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:07.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:07.010+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:07.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:07.317+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:08.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:08.021+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:08.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:08.325+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:08.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:08.994+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:09.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:09.312+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:10.026 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:10.026+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:10.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:10.315+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:10.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:10.980+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:11.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:11.343+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:11.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:11.961+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:12.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:12.354+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:12.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:12.932+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:13.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:13.334+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:13.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:13.891+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:14.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:14.384+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:14.902 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:14.901+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:15.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:15.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:15.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:15.899+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:16.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:16.402+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:16.870 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:16.869+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:17.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:17.445+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:17.842 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:17.841+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:18.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:18.413+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:18.846 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:18.845+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:19.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:19.373+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:19.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:19.861+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:20.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:20.347+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:20.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:20.886+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:21.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:21.303+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:21.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:21.892+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:22.337 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:22.336+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:22.939 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:22.938+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:23.350 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:23.348+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:23.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:23.921+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:24.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:24.326+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:24.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:24.951+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:25.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:25.348+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:25.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:25.993+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:26.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:26.307+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:26.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:26.947+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:27.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:27.336+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:27.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:27.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:28.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:28.355+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:28.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:28.945+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:29.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:29.329+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:29.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:29.935+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:30.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:30.350+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:30.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:30.898+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:31.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:31.380+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:31.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:31.911+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:32.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:32.390+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:32.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:32.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:33.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:33.365+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:33.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:33.943+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:34.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:34.370+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:34.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:34.981+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:35.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:35.354+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:35.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:35.933+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:36.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:36.367+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:36.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:36.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:37.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:37.414+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:37.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:37.932+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:38.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:38.416+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:38.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:38.908+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:39.414 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:39.413+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:39.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:39.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:40.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:40.411+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:40.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:40.953+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:41.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:41.410+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:41.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:41.979+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:42.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:42.425+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:42.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:42.980+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:43.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:43.440+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:43.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:43.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:44.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:44.421+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:44.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:44.953+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:45.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:45.429+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:45.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:45.971+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:46.431 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:46.430+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:46.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:46.990+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:47.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:47.392+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:48.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:48.024+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:48.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:48.365+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:49.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:49.057+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:49.410 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:49.408+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:50.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:50.101+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:50.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:50.434+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:51.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:51.074+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:51.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:51.411+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:52.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:52.035+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:52.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:52.371+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:53.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:53.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:53.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:53.371+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:54.048 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:54.048+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:54.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:54.409+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:55.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:55.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:55.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:55.369+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:56.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:56.021+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:56.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:56.379+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:57.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:57.048+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:57.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:57.385+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:58.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:58.046+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:58.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:58.359+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:59.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:49:59.043+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:49:59.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:49:59.330+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:00.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:00.085+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:00.377 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:00.377+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:01.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:01.124+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:01.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:01.422+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:02.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:02.138+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:02.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:02.467+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:03.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:03.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:03.432 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:03.431+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:04.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:04.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:04.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:04.461+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:05.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:05.119+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:05.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:05.434+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:06.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:06.130+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:06.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:06.478+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:07.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:07.162+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:07.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:07.464+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:08.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:08.152+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:08.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:08.421+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:09.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:09.170+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:09.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:09.395+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:10.131 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:10.129+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:10.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:10.379+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:11.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:11.083+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:11.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:11.400+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:12.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:12.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:12.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:12.447+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:13.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:13.089+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:13.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:13.451+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:14.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:14.077+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:14.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:14.460+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:15.105 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:15.104+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:15.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:15.426+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:16.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:16.100+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:16.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:16.412+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:17.136 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:17.135+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:17.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:17.368+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:18.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:18.101+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:18.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:18.368+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:19.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:19.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:19.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:19.408+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:20.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:20.120+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:20.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:20.379+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:21.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:21.076+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:21.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:21.429+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:22.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:22.070+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:22.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:22.475+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:23.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:23.074+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:23.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:23.467+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:24.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:24.049+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:24.429 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:24.427+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:25.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:25.072+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:25.472 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:25.471+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:26.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:26.113+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:26.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:26.450+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:27.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:27.066+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:27.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:27.487+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:28.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:28.115+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:28.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:28.450+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:29.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:29.149+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:29.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:29.487+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:30.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:30.141+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:30.485 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:30.484+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:31.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:31.126+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:31.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:31.523+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:32.121 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:32.120+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:32.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:32.545+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:33.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:33.107+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:33.503 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:33.502+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:34.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:34.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:34.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:34.491+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:35.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:35.106+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:35.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:35.450+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:36.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:36.135+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:36.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:36.441+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:37.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:37.142+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:37.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:37.435+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:38.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:38.175+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:38.406 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:38.405+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:39.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:39.219+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:39.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:39.360+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:40.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:40.247+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:40.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:40.354+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:41.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:41.233+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:41.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:41.379+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:42.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:42.240+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:42.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:42.345+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:43.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:43.288+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:43.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:43.368+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:44.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:44.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:44.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:44.361+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:45.226 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:45.226+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:45.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:45.395+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:46.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:46.231+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:46.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:46.422+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:47.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:47.279+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:47.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:47.455+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:48.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:48.234+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:48.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:48.426+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:49.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:49.216+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:49.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:49.386+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:50.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:50.201+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:50.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:50.370+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:51.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:51.205+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:51.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:51.414+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:52.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:52.218+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:52.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:52.463+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:53.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:53.181+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:53.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:53.470+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:54.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:54.213+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:54.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:54.482+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:55.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:55.175+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:55.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:55.438+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:56.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:56.154+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:56.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:56.475+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:57.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:57.180+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:57.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:57.442+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:58.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:58.212+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:58.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:58.470+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:59.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:50:59.193+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:50:59.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:50:59.439+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:00.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:00.220+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:00.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:00.451+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:01.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:01.188+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:01.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:01.435+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:02.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:02.182+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:02.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:02.394+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:03.168 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:03.167+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:03.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:03.406+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:04.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:04.184+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:04.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:04.370+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:05.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:05.183+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:05.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:05.384+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:06.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:06.148+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:06.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:06.350+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:07.179 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:07.177+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:07.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:07.312+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:08.158 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:08.157+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:08.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:08.312+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:09.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:09.123+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:09.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:09.356+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:10.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:10.107+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:10.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:10.319+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:11.134 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:11.133+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:11.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:11.329+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:12.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:12.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:12.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:12.373+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:13.095 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:13.094+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:13.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:13.326+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:14.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:14.078+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:14.289 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:14.288+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:15.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:15.058+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:15.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:15.282+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:16.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:16.016+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:16.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:16.285+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:17.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:17.036+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:17.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:17.269+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:18.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:18.081+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:18.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:18.237+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:19.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:19.046+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:19.212 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:19.211+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:20.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:20.015+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:20.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:20.217+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:20.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:20.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:21.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:21.234+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:21.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:21.954+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:22.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:22.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:22.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:22.936+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:23.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:23.262+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:23.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:23.921+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:24.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:24.243+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:24.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:24.918+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:25.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:25.206+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:25.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:25.919+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:26.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:26.165+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:26.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:26.962+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:27.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:27.117+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:27.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:27.938+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:28.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:28.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:28.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:28.910+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:29.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:29.042+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:29.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:29.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:30.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:30.037+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:30.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:30.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:31.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:31.012+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:31.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:31.935+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:32.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:32.053+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:32.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:32.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:33.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:33.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:33.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:33.965+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:34.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:34.009+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:34.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:34.923+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:34.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:34.998+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:35.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:35.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:35.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:35.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:36.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:36.924+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:36.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:36.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:37.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:37.911+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:38.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:38.001+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:38.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:38.943+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:39.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:39.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:39.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:39.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:40.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:40.014+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:41.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:41.001+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:41.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:41.039+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:42.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:42.003+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:42.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:42.029+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:42.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:42.989+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:43.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:43.004+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:43.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:43.972+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:44.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:44.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:44.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:44.974+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:45.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:45.041+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:45.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:45.990+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:46.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:46.091+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:47.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:47.011+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:47.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:47.111+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:48.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:48.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:48.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:48.137+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:49.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:49.059+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:49.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:49.157+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:50.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:50.092+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:50.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:50.167+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:51.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:51.116+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:51.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:51.140+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:52.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:52.126+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:52.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:52.155+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:53.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:53.088+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:53.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:53.119+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:54.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:54.087+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:54.140 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:54.139+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:55.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:55.045+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:55.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:55.111+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:56.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:56.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:56.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:56.153+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:57.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:57.016+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:57.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:57.148+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:58.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:58.044+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:58.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:58.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:59.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:51:59.049+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:51:59.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:51:59.067+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:00.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:00.060+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:00.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:00.078+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:01.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:01.026+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:01.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:01.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:02.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:02.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:02.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:02.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:03.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:03.006+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:03.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:03.123+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:04.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:04.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:04.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:04.094+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:05.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:05.000+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:05.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:05.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:06.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:06.013+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:06.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:06.102+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:07.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:07.030+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:07.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:07.083+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:08.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:08.018+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:08.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:08.123+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:08.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:08.970+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:09.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:09.172+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:09.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:09.956+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:10.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:10.149+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:10.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:10.952+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:11.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:11.178+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:11.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:11.951+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:12.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:12.185+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:12.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:12.951+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:13.217 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:13.216+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:13.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:13.926+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:14.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:14.241+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:14.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:14.940+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:15.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:15.196+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:15.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:15.940+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:16.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:16.192+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:16.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:16.938+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:17.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:17.214+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:17.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:17.958+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:18.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:18.226+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:18.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:18.918+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:19.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:19.218+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:19.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:19.923+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:20.190 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:20.190+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:20.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:20.948+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:21.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:21.163+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:21.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:21.979+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:22.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:22.141+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:22.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:22.953+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:23.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:23.149+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:23.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:23.917+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:24.169 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:24.168+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:24.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:24.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:25.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:25.176+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:25.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:25.882+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:26.175 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:26.174+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:26.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:26.861+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:27.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:27.151+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:27.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:27.842+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:28.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:28.125+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:28.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:28.811+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:29.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:29.163+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:29.778 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:29.777+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:30.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:30.175+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:30.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:30.797+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:31.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:31.214+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:31.827 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:31.826+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:32.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:32.215+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:32.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:32.779+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:33.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:33.214+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:33.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:33.784+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:34.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:34.248+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:34.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:34.746+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:35.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:35.243+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:35.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:35.737+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:36.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:36.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:36.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:36.736+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:37.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:37.213+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:37.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:37.786+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:38.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:38.244+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:38.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:38.827+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:39.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:39.268+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:39.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:39.850+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:40.258 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:40.257+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:40.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:40.896+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:41.260 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:41.259+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:41.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:41.905+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:42.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:42.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:42.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:42.935+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:43.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:43.233+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:43.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:43.909+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:44.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:44.272+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:44.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:44.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:45.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:45.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:45.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:45.935+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:46.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:46.305+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:46.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:46.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:47.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:47.294+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:47.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:47.920+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:48.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:48.339+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:48.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:48.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:49.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:49.323+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:49.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:49.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:50.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:50.351+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:50.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:50.939+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:51.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:51.365+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:51.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:51.914+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:52.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:52.362+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:52.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:52.941+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:53.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:53.334+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:53.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:53.926+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:54.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:54.377+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:54.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:54.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:55.336 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:55.335+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:56.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:56.000+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:56.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:56.324+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:57.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:57.039+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:57.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:57.277+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:58.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:58.024+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:58.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:58.272+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:59.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:52:59.022+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:52:59.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:52:59.300+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:00.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:00.052+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:00.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:00.340+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:01.083 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:01.083+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:01.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:01.378+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:02.131 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:02.130+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:02.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:02.329+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:03.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:03.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:03.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:03.326+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:04.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:04.067+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:04.358 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:04.358+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:05.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:05.100+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:05.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:05.387+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:06.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:06.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:06.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:06.433+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:07.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:07.006+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:07.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:07.449+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:08.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:08.001+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:08.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:08.497+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:08.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:08.952+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:09.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:09.454+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:09.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:09.930+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:10.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:10.420+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:10.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:10.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:11.390 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:11.389+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:11.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:11.929+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:12.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:12.416+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:12.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:12.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:13.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:13.460+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:13.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:13.873+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:14.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:14.420+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:14.858 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:14.857+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:15.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:15.392+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:15.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:15.882+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:16.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:16.442+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:16.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:16.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:17.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:17.399+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:17.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:17.936+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:18.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:18.443+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:18.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:18.893+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:19.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:19.435+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:19.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:19.878+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:20.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:20.459+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:20.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:20.919+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:21.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:21.482+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:21.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:21.870+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:22.459 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:22.458+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:22.856 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:22.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:23.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:23.427+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:23.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:23.848+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:24.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:24.393+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:24.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:24.813+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:25.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:25.377+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:25.795 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:25.794+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:26.419 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:26.418+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:26.781 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:26.780+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:27.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:27.382+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:27.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:27.737+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:28.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:28.338+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:28.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:28.703+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:29.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:29.355+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:29.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:29.733+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:30.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:30.353+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:30.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:30.709+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:31.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:31.330+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:31.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:31.717+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:32.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:32.351+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:32.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:32.767+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:33.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:33.319+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:33.728 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:33.727+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:34.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:34.329+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:34.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:34.694+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:35.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:35.323+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:35.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:35.689+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:36.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:36.362+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:36.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:36.688+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:37.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:37.412+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:37.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:37.656+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:38.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:38.395+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:38.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:38.665+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:39.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:39.395+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:39.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:39.698+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:40.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:40.442+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:40.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:40.727+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:41.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:41.419+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:41.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:41.720+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:42.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:42.385+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:42.716 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:42.715+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:43.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:43.413+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:43.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:43.762+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:44.410 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:44.409+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:44.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:44.746+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:45.404 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:45.404+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:45.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:45.745+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:46.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:46.369+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:46.697 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:46.696+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:47.336 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:47.336+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:47.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:47.693+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:48.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:48.307+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:48.648 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:48.648+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:49.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:49.271+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:49.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:49.641+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:50.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:50.261+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:50.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:50.668+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:51.262 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:51.262+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:51.673 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:51.673+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:52.299 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:52.299+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:52.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:52.699+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:53.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:53.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:53.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:53.714+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:54.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:54.332+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:54.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:54.691+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:55.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:55.314+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:55.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:55.723+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:56.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:56.339+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:56.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:56.675+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:57.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:57.384+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:57.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:57.637+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:58.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:58.420+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:58.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:58.628+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:59.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:53:59.441+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:53:59.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:53:59.583+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:00.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:00.483+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:00.610 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:00.608+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:01.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:01.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:01.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:01.642+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:02.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:02.547+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:02.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:02.615+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:03.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:03.519+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:03.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:03.636+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:04.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:04.544+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:04.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:04.674+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:05.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:05.567+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:05.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:05.667+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:06.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:06.563+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:06.620 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:06.619+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:07.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:07.552+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:07.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:07.639+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:08.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:08.537+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:08.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:08.634+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:09.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:09.579+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:09.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:09.636+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:10.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:10.553+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:10.621 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:10.619+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:11.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:11.538+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:11.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:11.670+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:12.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:12.527+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:12.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:12.682+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:13.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:13.492+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:13.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:13.716+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:14.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:14.457+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:14.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:14.713+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:15.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:15.473+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:15.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:15.719+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:16.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:16.440+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:16.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:16.694+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:17.406 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:17.405+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:17.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:17.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:18.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:18.398+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:18.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:18.736+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:19.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:19.429+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:19.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:19.729+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:20.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:20.459+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:20.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:20.685+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:21.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:21.420+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:21.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:21.716+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:22.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:22.381+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:22.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:22.679+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:23.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:23.387+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:23.685 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:23.684+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:24.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:24.356+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:24.701 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:24.700+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:25.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:25.313+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:25.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:25.655+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:26.266 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:26.265+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:26.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:26.680+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:27.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:27.267+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:27.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:27.694+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:28.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:28.310+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:28.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:28.735+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:29.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:29.359+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:29.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:29.728+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:30.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:30.323+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:30.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:30.731+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:31.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:31.369+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:31.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:31.743+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:32.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:32.368+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:32.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:32.764+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:33.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:33.351+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:33.757 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:33.757+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:34.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:34.363+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:34.777 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:34.777+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:35.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:35.349+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:35.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:35.816+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:36.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:36.371+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:36.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:36.847+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:37.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:37.420+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:37.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:37.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:38.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:38.413+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:38.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:38.847+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:39.377 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:39.376+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:39.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:39.799+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:40.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:40.355+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:40.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:40.782+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:41.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:41.344+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:41.830 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:41.829+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:42.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:42.328+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:42.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:42.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:43.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:43.308+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:43.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:43.827+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:44.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:44.270+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:44.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:44.822+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:45.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:45.312+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:45.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:45.864+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:46.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:46.286+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:46.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:46.840+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:47.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:47.269+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:47.805 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:47.804+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:48.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:48.250+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:48.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:48.762+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:49.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:49.287+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:49.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:49.788+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:50.249 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:50.248+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:50.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:50.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:51.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:51.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:51.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:51.838+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:52.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:52.232+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:52.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:52.862+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:53.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:53.278+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:53.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:53.896+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:54.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:54.235+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:54.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:54.923+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:55.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:55.263+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:55.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:55.946+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:56.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:56.241+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:56.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:56.930+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:57.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:57.266+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:57.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:57.900+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:58.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:58.259+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:58.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:58.928+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:59.242 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:54:59.240+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:54:59.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:54:59.884+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:00.262 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:00.261+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:00.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:00.849+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:01.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:01.224+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:01.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:01.818+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:02.249 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:02.247+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:02.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:02.775+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:03.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:03.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:03.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:03.758+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:04.237 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:04.236+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:04.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:04.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:05.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:05.218+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:05.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:05.783+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:06.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:06.254+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:06.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:06.824+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:07.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:07.286+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:07.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:07.842+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:08.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:08.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:08.814 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:08.813+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:09.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:09.286+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:09.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:09.840+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:10.299 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:10.298+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:10.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:10.827+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:11.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:11.290+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:11.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:11.782+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:12.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:12.309+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:12.743 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:12.742+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:13.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:13.344+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:13.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:13.692+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:14.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:14.316+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:14.650 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:14.648+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:15.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:15.270+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:15.615 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:15.614+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:16.254 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:16.253+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:16.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:16.599+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:17.294 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:17.293+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:17.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:17.605+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:18.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:18.291+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:18.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:18.593+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:19.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:19.264+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:19.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:19.582+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:20.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:20.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:20.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:20.537+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:21.337 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:21.337+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:21.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:21.531+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:22.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:22.381+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:22.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:22.570+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:23.376 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:23.376+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:23.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:23.523+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:24.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:24.421+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:24.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:24.491+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:25.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:25.379+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:25.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:25.508+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:26.416 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:26.416+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:26.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:26.513+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:27.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:27.413+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:27.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:27.507+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:28.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:28.440+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:28.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:28.478+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:29.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:29.432+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:29.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:29.474+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:30.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:30.478+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:30.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:30.482+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:31.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:31.448+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:31.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:31.478+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:32.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:32.432+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:32.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:32.446+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:33.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:33.464+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:33.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:33.488+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:34.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:34.425+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:34.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:34.483+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:35.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:35.466+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:35.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:35.482+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:36.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:36.438+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:36.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:36.514+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:37.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:37.420+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:37.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:37.537+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:38.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:38.398+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:38.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:38.548+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:39.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:39.419+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:39.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:39.510+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:40.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:40.397+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:40.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:40.481+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:41.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:41.425+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:41.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:41.529+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:42.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:42.381+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:42.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:42.483+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:43.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:43.340+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:43.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:43.518+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:44.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:44.306+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:44.485 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:44.484+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:45.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:45.350+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:45.456 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:45.455+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:46.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:46.308+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:46.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:46.503+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:47.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:47.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:47.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:47.487+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:48.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:48.302+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:48.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:48.495+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:49.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:49.278+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:49.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:49.483+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:50.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:50.232+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:50.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:50.486+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:51.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:51.203+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:51.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:51.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:52.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:52.223+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:52.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:52.491+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:53.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:53.267+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:53.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:53.513+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:54.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:54.310+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:54.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:54.540+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:55.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:55.271+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:55.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:55.543+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:56.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:56.280+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:56.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:56.569+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:57.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:57.309+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:57.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:57.597+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:58.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:58.319+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:58.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:58.589+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:59.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:55:59.367+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:55:59.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:55:59.574+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:00.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:00.351+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:00.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:00.564+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:01.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:01.356+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:01.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:01.610+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:02.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:02.381+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:02.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:02.569+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:03.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:03.404+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:03.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:03.583+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:04.402 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:04.401+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:04.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:04.605+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:05.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:05.384+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:05.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:05.586+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:06.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:06.389+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:06.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:06.627+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:07.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:07.395+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:07.618 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:07.618+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:08.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:08.438+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:08.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:08.624+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:09.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:09.466+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:09.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:09.579+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:10.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:10.490+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:10.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:10.552+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:11.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:11.517+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:11.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:11.518+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:12.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:12.489+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:12.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:12.554+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:13.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:13.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:13.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:13.511+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:14.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:14.494+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:14.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:14.510+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:15.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:15.509+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:15.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:15.533+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:16.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:16.486+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:16.503 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:16.502+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:17.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:17.463+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:17.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:17.505+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:18.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:18.467+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:18.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:18.469+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:19.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:19.441+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:19.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:19.473+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:20.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:20.395+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:20.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:20.511+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:21.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:21.421+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:21.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:21.529+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:22.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:22.433+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:22.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:22.519+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:23.418 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:23.417+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:23.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:23.547+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:24.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:24.457+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:24.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:24.559+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:25.500 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:25.498+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:25.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:25.603+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:26.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:26.459+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:26.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:26.618+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:27.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:27.453+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:27.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:27.625+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:28.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:28.445+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:28.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:28.627+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:29.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:29.461+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:29.591 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:29.590+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:30.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:30.501+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:30.587 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:30.586+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:31.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:31.524+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:31.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:31.551+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:32.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:32.476+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:32.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:32.585+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:33.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:33.500+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:33.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:33.546+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:34.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:34.456+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:34.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:34.502+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:35.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:35.457+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:35.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:35.479+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:36.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:36.425+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:36.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:36.448+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:37.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:37.426+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:37.456 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:37.455+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:38.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:38.439+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:38.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:38.474+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:39.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:39.449+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:39.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:39.489+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:40.442 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:40.441+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:40.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:40.486+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:41.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:41.408+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:41.537 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:41.536+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:42.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:42.383+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:42.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:42.580+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:43.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:43.346+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:43.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:43.621+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:44.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:44.311+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:44.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:44.584+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:45.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:45.292+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:45.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:45.596+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:46.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:46.288+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:46.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:46.632+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:47.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:47.255+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:47.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:47.619+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:48.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:48.305+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:48.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:48.609+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:49.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:49.268+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:49.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:49.643+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:50.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:50.237+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:50.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:50.610+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:51.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:51.271+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:51.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:51.657+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:52.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:52.321+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:52.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:52.630+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:53.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:53.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:53.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:53.676+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:54.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:54.324+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:54.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:54.709+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:55.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:55.369+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:55.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:55.749+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:56.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:56.347+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:56.740 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:56.740+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:57.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:57.341+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:57.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:57.755+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:58.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:58.307+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:58.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:58.730+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:59.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:56:59.278+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:56:59.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:56:59.728+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:00.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:00.298+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:00.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:00.716+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:01.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:01.273+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:01.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:01.725+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:02.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:02.288+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:02.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:02.704+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:03.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:03.257+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:03.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:03.674+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:04.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:04.223+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:04.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:04.688+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:05.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:05.208+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:05.683 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:05.682+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:06.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:06.198+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:06.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:06.657+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:07.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:07.172+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:07.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:07.672+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:08.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:08.207+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:08.652 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:08.651+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:09.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:09.170+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:09.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:09.653+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:10.210 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:10.209+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:10.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:10.613+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:11.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:11.179+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:11.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:11.639+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:12.134 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:12.133+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:12.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:12.655+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:13.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:13.164+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:13.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:13.699+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:14.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:14.210+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:14.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:14.741+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:15.170 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:15.169+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:15.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:15.785+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:16.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:16.154+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:16.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:16.791+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:17.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:17.202+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:17.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:17.827+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:18.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:18.246+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:18.812 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:18.811+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:19.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:19.217+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:19.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:19.773+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:20.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:20.182+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:20.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:20.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:21.136 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:21.135+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:21.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:21.741+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:22.174 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:22.173+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:22.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:22.775+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:23.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:23.171+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:23.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:23.781+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:24.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:24.207+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:24.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:24.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:25.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:25.215+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:25.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:25.791+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:26.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:26.239+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:26.787 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:26.786+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:27.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:27.195+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:27.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:27.787+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:28.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:28.152+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:28.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:28.830+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:29.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:29.137+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:29.864 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:29.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:30.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:30.156+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:30.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:30.856+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:31.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:31.108+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:31.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:31.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:32.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:32.069+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:32.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:32.891+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:33.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:33.093+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:33.884 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:33.883+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:34.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:34.045+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:34.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:34.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:35.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:35.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:35.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:35.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:36.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:36.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:36.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:36.841+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:37.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:37.041+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:37.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:37.808+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:38.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:38.010+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:38.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:38.843+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:39.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:39.034+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:39.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:39.832+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:40.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:40.006+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:40.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:40.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:40.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:40.974+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:41.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:41.852+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:42.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:42.013+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:42.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:42.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:42.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:42.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:43.812 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:43.812+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:44.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:44.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:44.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:44.820+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:44.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:44.993+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:45.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:45.835+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:45.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:45.986+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:46.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:46.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:46.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:46.947+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:47.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:47.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:47.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:47.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:48.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:48.860+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:48.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:48.972+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:49.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:49.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:49.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:49.937+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:50.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:50.835+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:50.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:50.942+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:51.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:51.842+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:51.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:51.977+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:52.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:52.793+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:52.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:52.967+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:53.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:53.789+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:53.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:53.928+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:54.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:54.776+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:54.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:54.962+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:55.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:55.733+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:55.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:55.987+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:56.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:56.775+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:56.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:56.984+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:57.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:57.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:58.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:58.011+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:58.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:58.812+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:58.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:58.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:59.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:57:59.778+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:57:59.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:57:59.962+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:00.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:00.775+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:00.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:00.987+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:01.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:01.784+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:01.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:01.967+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:02.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:02.801+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:02.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:02.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:03.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:03.753+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:03.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:03.974+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:04.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:04.776+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:05.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:05.020+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:05.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:05.815+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:06.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:06.040+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:06.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:06.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:07.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:07.057+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:07.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:07.750+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:08.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:08.008+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:08.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:08.750+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:09.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:09.039+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:09.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:09.757+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:10.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:10.016+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:10.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:10.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:11.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:11.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:11.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:11.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:12.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:12.069+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:12.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:12.768+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:13.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:13.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:13.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:13.784+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:14.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:14.119+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:14.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:14.769+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:15.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:15.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:15.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:15.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:16.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:16.074+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:16.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:16.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:17.121 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:17.120+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:17.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:17.793+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:18.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:18.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:18.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:18.796+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:19.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:19.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:19.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:19.803+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:20.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:20.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:20.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:20.819+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:21.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:21.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:21.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:21.870+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:22.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:22.077+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:22.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:22.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:23.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:23.096+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:23.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:23.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:24.116 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:24.117+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:24.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:24.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:25.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:25.154+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:25.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:25.764+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:26.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:26.201+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:26.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:26.792+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:27.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:27.224+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:27.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:27.816+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:28.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:28.193+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:28.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:28.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:29.226 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:29.226+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:29.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:29.901+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:30.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:30.192+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:30.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:30.926+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:31.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:31.181+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:31.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:31.974+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:32.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:32.218+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:32.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:32.945+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:33.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:33.258+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:33.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:33.968+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:34.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:34.214+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:35.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:35.006+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:35.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:35.235+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:35.991 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:35.990+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:36.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:36.194+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:36.987 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:36.986+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:37.210 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:37.209+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:37.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:37.996+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:38.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:38.211+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:38.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:38.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:39.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:39.213+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:39.924 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:39.923+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:40.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:40.260+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:40.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:40.931+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:41.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:41.284+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:41.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:41.891+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:42.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:42.283+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:42.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:42.887+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:43.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:43.296+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:43.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:43.889+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:44.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:44.261+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:44.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:44.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:45.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:45.311+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:45.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:45.903+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:46.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:46.294+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:46.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:46.918+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:47.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:47.291+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:47.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:47.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:48.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:48.278+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:48.987 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:48.986+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:49.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:49.270+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:50.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:50.015+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:50.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:50.247+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:51.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:51.034+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:51.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:51.205+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:51.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:51.987+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:52.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:52.210+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:53.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:53.025+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:53.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:53.235+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:54.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:54.033+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:54.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:54.203+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:55.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:55.035+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:55.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:55.156+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:56.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:56.008+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:56.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:56.138+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:57.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:57.020+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:57.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:57.123+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:57.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:57.981+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:58.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:58.129+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:58.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:58.980+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:59.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:58:59.103+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:58:59.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:58:59.996+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:00.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:00.152+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:01.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:01.012+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:01.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:01.184+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:02.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:02.034+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:02.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:02.201+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:03.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:03.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:03.245 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:03.244+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:04.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:04.060+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:04.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:04.288+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:05.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:05.042+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:05.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:05.312+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:06.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:06.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:06.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:06.347+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:07.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:07.031+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:07.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:07.361+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:08.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:08.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:08.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:08.323+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:09.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:09.008+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:09.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:09.360+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:09.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:09.997+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:10.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:10.387+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:10.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:10.976+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:11.402 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:11.401+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:11.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:11.982+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:12.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:12.371+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:13.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:13.004+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:13.345 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:13.345+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:13.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:13.960+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:14.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:14.387+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:14.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:14.913+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:15.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:15.435+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:15.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:15.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:16.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:16.388+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:16.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:16.856+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:17.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:17.422+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:17.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:17.883+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:18.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:18.452+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:18.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:18.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:19.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:19.469+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:19.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:19.879+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:20.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:20.465+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:20.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:20.886+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:21.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:21.418+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:21.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:21.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:22.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:22.404+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:22.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:22.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:23.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:23.440+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:23.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:23.895+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:24.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:24.481+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:24.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:24.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:25.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:25.462+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:25.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:25.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:26.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:26.493+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:26.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:26.857+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:27.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:27.493+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:27.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:27.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:28.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:28.459+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:28.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:28.821+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:29.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:29.438+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:29.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:29.824+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:30.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:30.468+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:30.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:30.794+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:31.456 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:31.455+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:31.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:31.815+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:32.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:32.478+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:32.822 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:32.822+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:33.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:33.469+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:33.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:33.862+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:34.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:34.435+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:34.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:34.864+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:35.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:35.434+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:35.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:35.839+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:36.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:36.401+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:36.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:36.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:37.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:37.370+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:37.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:37.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:38.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:38.380+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:38.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:38.837+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:39.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:39.334+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:39.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:39.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:40.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:40.319+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:40.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:40.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:41.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:41.321+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:41.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:41.906+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:42.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:42.340+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:42.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:42.865+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:43.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:43.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:43.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:43.888+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:44.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:44.292+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:44.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:44.930+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:45.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:45.272+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:45.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:45.914+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:46.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:46.300+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:46.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:46.898+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:47.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:47.279+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:47.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:47.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:48.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:48.266+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:48.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:48.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:49.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:49.316+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:49.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:49.903+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:50.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:50.306+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:50.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:50.935+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:51.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:51.271+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:51.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:51.932+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:52.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:52.280+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:52.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:52.972+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:53.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:53.252+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:53.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:53.951+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:54.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:54.213+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:54.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:54.936+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:55.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:55.213+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:55.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:55.947+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:56.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:56.175+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:56.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:56.939+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:57.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:57.161+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:57.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:57.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:58.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:58.114+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:58.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:58.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:59.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T13:59:59.076+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T13:59:59.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T13:59:59.857+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:00.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:00.121+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:00.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:00.902+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:01.170 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:01.170+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:01.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:01.894+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:02.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:02.169+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:02.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:02.921+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:03.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:03.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:03.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:03.945+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:04.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:04.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:04.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:04.919+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:05.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:05.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:05.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:05.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:06.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:06.100+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:06.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:06.884+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:07.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:07.103+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:07.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:07.932+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:08.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:08.114+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:08.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:08.889+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:09.134 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:09.134+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:09.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:09.911+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:10.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:10.087+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:10.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:10.948+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:11.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:11.116+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:11.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:11.999+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:12.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:12.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:13.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:13.033+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:13.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:13.091+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:14.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:14.039+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:14.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:14.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:15.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:15.014+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:15.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:15.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:16.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:16.003+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:16.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:16.025+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:17.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:17.030+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:17.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:17.041+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:18.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:18.009+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:18.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:18.049+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:18.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:18.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:19.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:19.033+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:19.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:19.966+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:20.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:20.048+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:20.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:20.937+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:21.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:21.068+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:21.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:21.972+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:22.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:22.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:22.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:22.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:23.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:23.118+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:23.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:23.955+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:24.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:24.074+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:24.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:24.983+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:25.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:25.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:25.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:25.970+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:26.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:26.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:27.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:27.019+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:27.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:27.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:28.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:28.051+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:28.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:28.107+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:29.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:29.044+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:29.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:29.141+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:30.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:30.008+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:30.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:30.151+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:31.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:31.010+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:31.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:31.188+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:32.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:32.045+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:32.223 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:32.223+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:33.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:33.023+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:33.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:33.243+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:33.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:33.989+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:34.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:34.276+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:35.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:35.009+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:35.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:35.239+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:36.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:36.013+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:36.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:36.237+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:36.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:36.973+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:37.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:37.275+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:37.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:37.961+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:38.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:38.303+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:38.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:38.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:39.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:39.303+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:39.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:39.947+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:40.267 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:40.266+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:40.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:40.997+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:41.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:41.276+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:42.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:42.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:42.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:42.322+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:43.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:43.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:43.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:43.286+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:44.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:44.046+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:44.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:44.239+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:45.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:45.048+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:45.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:45.193+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:46.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:46.021+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:46.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:46.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:46.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:46.990+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:47.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:47.173+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:47.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:47.975+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:48.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:48.161+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:48.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:48.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:49.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:49.205+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:49.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:49.966+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:50.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:50.245+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:50.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:50.956+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:51.224 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:51.224+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:51.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:51.993+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:52.186 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:52.186+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:53.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:53.006+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:53.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:53.232+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:54.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:54.050+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:54.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:54.227+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:55.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:55.089+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:55.262 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:55.262+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:56.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:56.076+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:56.274 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:56.274+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:57.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:57.113+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:57.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:57.318+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:58.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:58.148+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:58.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:58.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:59.162 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:00:59.161+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:00:59.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:00:59.307+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:00.180 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:00.180+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:00.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:00.356+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:01.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:01.222+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:01.316 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:01.316+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:02.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:02.234+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:02.292 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:02.292+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:03.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:03.248+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:03.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:03.255+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:04.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:04.220+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:04.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:04.263+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:05.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:05.206+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:05.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:05.313+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:06.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:06.213+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:06.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:06.332+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:07.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:07.189+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:07.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:07.348+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:08.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:08.235+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:08.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:08.340+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:09.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:09.198+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:09.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:09.333+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:10.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:10.208+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:10.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:10.285+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:11.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:11.176+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:11.316 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:11.316+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:12.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:12.195+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:12.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:12.326+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:13.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:13.145+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:13.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:13.354+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:14.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:14.132+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:14.377 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:14.377+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:15.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:15.149+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:15.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:15.414+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:16.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:16.114+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:16.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:16.464+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:17.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:17.067+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:17.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:17.466+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:18.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:18.020+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:18.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:18.427+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:19.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:19.070+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:19.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:19.470+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:20.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:20.099+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:20.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:20.435+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:21.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:21.059+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:21.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:21.476+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:22.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:22.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:22.429 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:22.429+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:23.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:23.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:23.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:23.399+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:24.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:24.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:24.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:24.399+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:25.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:25.069+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:25.432 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:25.431+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:26.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:26.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:26.438 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:26.438+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:27.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:27.023+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:27.410 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:27.410+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:28.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:28.047+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:28.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:28.393+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:29.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:29.064+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:29.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:29.382+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:30.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:30.060+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:30.376 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:30.376+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:31.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:31.045+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:31.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:31.364+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:32.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:32.025+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:32.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:32.348+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:33.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:33.003+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:33.301 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:33.302+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:34.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:34.052+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:34.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:34.338+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:35.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:35.005+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:35.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:35.358+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:36.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:36.043+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:36.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:36.365+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:37.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:37.044+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:37.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:37.345+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:38.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:38.000+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:38.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:38.327+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:39.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:39.045+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:39.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:39.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:40.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:40.024+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:40.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:40.289+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:40.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:40.981+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:41.289 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:41.288+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:42.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:42.005+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:42.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:42.305+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:42.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:42.975+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:43.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:43.287+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:43.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:43.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:44.251 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:44.251+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:44.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:44.983+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:45.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:45.284+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:46.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:46.015+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:46.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:46.293+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:47.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:47.012+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:47.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:47.310+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:48.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:48.043+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:48.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:48.333+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:49.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:49.092+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:49.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:49.333+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:50.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:50.091+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:50.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:50.338+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:51.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:51.062+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:51.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:51.329+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:52.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:52.076+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:52.358 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:52.357+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:53.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:53.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:53.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:53.370+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:54.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:54.084+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:54.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:54.401+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:55.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:55.113+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:55.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:55.417+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:56.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:56.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:56.373 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:56.370+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:57.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:57.033+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:57.373 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:57.373+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:58.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:58.075+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:58.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:58.345+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:59.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:01:59.091+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:01:59.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:01:59.338+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:00.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:00.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:00.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:00.368+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:01.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:01.160+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:01.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:01.341+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:02.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:02.177+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:02.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:02.325+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:03.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:03.219+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:03.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:03.295+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:04.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:04.221+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:04.260 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:04.259+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:05.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:05.204+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:05.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:05.258+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:06.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:06.208+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:06.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:06.309+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:07.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:07.235+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:07.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:07.331+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:08.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:08.224+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:08.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:08.283+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:09.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:09.199+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:09.267 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:09.267+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:10.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:10.175+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:10.294 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:10.294+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:11.172 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:11.171+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:11.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:11.327+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:12.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:12.134+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:12.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:12.314+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:13.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:13.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:13.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:13.323+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:14.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:14.073+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:14.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:14.306+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:15.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:15.043+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:15.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:15.351+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:16.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:16.060+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:16.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:16.341+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:17.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:17.101+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:17.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:17.341+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:18.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:18.091+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:18.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:18.343+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:19.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:19.097+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:19.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:19.382+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:20.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:20.101+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:20.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:20.408+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:21.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:21.053+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:21.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:21.383+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:22.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:22.066+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:22.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:22.385+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:23.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:23.072+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:23.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:23.427+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:24.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:24.039+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:24.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:24.383+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:25.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:25.011+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:25.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:25.425+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:26.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:26.058+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:26.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:26.426+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:27.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:27.096+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:27.425 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:27.425+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:28.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:28.067+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:28.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:28.451+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:29.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:29.048+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:29.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:29.496+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:30.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:30.063+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:30.544 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:30.544+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:31.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:31.090+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:31.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:31.538+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:32.074 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:32.074+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:32.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:32.548+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:33.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:33.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:33.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:33.531+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:34.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:34.104+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:34.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:34.509+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:35.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:35.130+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:35.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:35.535+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:36.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:36.092+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:36.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:36.582+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:37.116 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:37.116+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:37.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:37.546+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:38.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:38.151+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:38.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:38.570+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:39.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:39.148+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:39.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:39.545+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:40.186 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:40.186+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:40.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:40.571+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:41.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:41.148+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:41.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:41.554+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:42.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:42.106+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:42.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:42.521+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:43.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:43.077+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:43.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:43.508+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:44.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:44.109+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:44.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:44.558+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:45.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:45.143+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:45.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:45.590+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:46.174 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:46.174+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:46.616 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:46.616+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:47.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:47.141+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:47.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:47.641+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:48.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:48.150+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:48.646 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:48.646+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:49.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:49.149+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:49.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:49.608+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:50.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:50.103+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:50.616 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:50.616+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:51.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:51.067+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:51.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:51.624+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:52.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:52.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:52.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:52.586+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:53.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:53.044+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:53.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:53.564+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:54.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:54.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:54.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:54.591+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:55.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:55.042+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:55.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:55.622+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:56.061 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:56.061+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:56.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:56.601+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:57.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:57.106+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:57.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:57.588+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:58.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:58.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:58.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:58.597+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:59.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:02:59.117+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:02:59.618 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:02:59.618+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:00.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:00.152+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:00.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:00.666+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:01.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:01.188+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:01.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:01.623+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:02.180 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:02.180+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:02.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:02.641+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:03.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:03.194+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:03.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:03.616+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:04.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:04.231+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:04.645 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:04.645+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:05.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:05.235+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:05.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:05.629+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:06.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:06.268+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:06.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:06.641+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:07.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:07.282+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:07.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:07.614+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:08.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:08.254+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:08.660 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:08.661+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:09.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:09.281+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:09.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:09.657+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:10.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:10.277+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:10.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:10.704+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:11.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:11.290+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:11.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:11.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:12.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:12.266+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:12.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:12.690+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:13.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:13.310+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:13.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:13.643+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:14.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:14.359+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:14.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:14.685+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:15.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:15.381+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:15.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:15.642+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:16.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:16.396+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:16.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:16.615+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:17.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:17.360+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:17.635 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:17.635+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:18.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:18.311+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:18.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:18.657+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:19.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:19.311+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:19.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:19.703+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:20.286 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:20.286+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:20.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:20.713+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:21.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:21.317+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:21.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:21.752+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:22.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:22.275+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:22.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:22.748+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:23.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:23.325+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:23.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:23.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:24.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:24.289+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:24.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:24.806+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:25.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:25.297+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:25.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:25.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:26.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:26.251+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:26.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:26.840+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:27.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:27.262+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:27.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:27.835+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:28.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:28.275+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:28.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:28.857+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:29.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:29.325+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:29.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:29.846+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:30.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:30.327+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:30.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:30.873+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:31.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:31.371+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:31.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:31.827+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:32.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:32.349+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:32.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:32.835+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:33.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:33.387+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:33.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:33.791+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:34.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:34.395+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:34.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:34.795+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:35.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:35.360+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:35.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:35.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:36.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:36.395+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:36.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:36.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:37.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:37.415+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:37.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:37.800+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:38.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:38.408+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:38.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:38.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:39.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:39.376+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:39.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:39.814+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:40.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:40.369+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:40.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:40.818+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:41.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:41.331+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:41.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:41.799+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:42.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:42.359+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:42.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:42.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:43.331 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:43.331+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:43.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:43.757+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:44.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:44.326+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:44.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:44.799+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:45.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:45.369+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:45.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:45.832+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:46.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:46.355+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:46.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:46.802+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:47.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:47.354+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:47.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:47.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:48.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:48.400+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:48.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:48.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:49.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:49.432+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:49.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:49.847+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:50.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:50.410+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:50.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:50.829+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:51.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:51.436+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:51.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:51.872+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:52.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:52.462+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:52.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:52.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:53.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:53.444+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:53.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:53.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:54.404 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:54.405+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:54.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:54.870+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:55.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:55.434+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:55.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:55.904+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:56.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:56.420+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:56.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:56.864+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:57.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:57.439+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:57.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:57.909+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:58.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:58.454+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:58.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:58.957+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:59.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:03:59.493+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:03:59.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:03:59.981+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:00.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:00.531+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:01.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:01.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:01.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:01.499+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:02.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:02.030+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:02.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:02.504+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:03.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:03.029+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:03.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:03.555+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:03.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:03.990+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:04.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:04.530+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:05.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:05.002+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:05.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:05.559+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:05.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:05.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:06.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:06.533+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:06.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:06.975+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:07.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:07.550+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:07.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:07.973+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:08.591 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:08.591+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:08.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:08.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:09.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:09.640+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:09.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:09.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:10.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:10.638+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:10.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:10.922+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:11.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:11.680+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:11.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:11.948+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:12.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:12.666+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:12.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:12.974+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:13.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:13.674+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:13.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:13.948+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:14.723 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:14.723+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:14.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:14.973+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:15.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:15.751+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:16.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:16.011+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:16.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:16.763+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:17.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:17.044+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:17.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:17.750+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:18.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:18.000+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:18.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:18.773+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:19.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:19.039+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:19.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:19.801+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:20.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:20.089+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:20.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:20.832+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:21.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:21.102+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:21.859 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:21.859+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:22.145 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:22.145+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:22.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:22.843+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:23.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:23.143+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:23.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:23.816+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:24.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:24.156+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:24.777 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:24.776+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:25.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:25.197+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:25.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:25.817+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:26.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:26.246+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:26.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:26.809+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:27.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:27.297+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:27.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:27.761+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:28.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:28.261+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:28.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:28.753+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:29.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:29.297+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:29.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:29.734+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:30.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:30.309+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:30.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:30.724+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:31.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:31.271+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:31.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:31.754+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:32.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:32.311+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:32.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:32.718+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:33.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:33.323+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:33.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:33.750+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:34.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:34.333+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:34.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:34.772+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:35.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:35.374+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:35.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:35.788+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:36.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:36.355+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:36.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:36.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:37.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:37.313+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:37.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:37.771+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:38.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:38.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:38.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:38.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:39.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:39.335+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:39.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:39.834+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:40.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:40.329+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:40.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:40.796+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:41.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:41.373+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:41.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:41.762+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:42.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:42.412+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:42.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:42.792+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:43.408 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:43.409+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:43.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:43.780+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:44.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:44.397+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:44.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:44.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:45.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:45.408+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:45.778 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:45.779+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:46.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:46.403+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:46.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:46.741+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:47.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:47.364+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:47.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:47.738+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:48.405 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:48.405+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:48.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:48.693+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:49.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:49.378+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:49.697 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:49.697+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:50.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:50.349+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:50.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:50.726+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:51.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:51.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:51.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:51.703+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:52.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:52.324+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:52.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:52.745+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:53.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:53.315+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:53.713 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:53.713+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:54.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:54.365+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:54.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:54.710+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:55.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:55.335+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:55.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:55.730+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:56.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:56.311+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:56.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:56.748+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:57.299 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:57.299+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:57.735 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:57.735+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:58.253 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:58.253+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:58.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:58.732+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:59.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:04:59.233+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:04:59.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:04:59.745+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:00.187 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:00.187+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:00.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:00.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:01.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:01.236+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:01.795 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:01.795+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:02.202 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:02.203+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:02.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:02.783+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:03.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:03.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:03.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:03.801+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:04.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:04.193+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:04.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:04.826+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:05.157 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:05.157+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:05.859 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:05.859+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:06.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:06.163+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:06.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:06.845+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:07.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:07.125+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:07.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:07.801+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:08.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:08.164+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:08.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:08.773+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:09.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:09.149+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:09.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:09.736+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:10.145 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:10.146+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:10.701 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:10.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:11.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:11.147+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:11.673 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:11.673+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:12.135 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:12.135+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:12.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:12.676+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:13.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:13.161+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:13.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:13.727+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:14.175 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:14.175+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:14.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:14.753+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:15.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:15.138+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:15.752 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:15.752+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:16.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:16.091+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:16.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:16.746+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:17.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:17.095+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:17.735 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:17.736+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:18.101 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:18.101+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:18.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:18.745+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:19.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:19.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:19.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:19.784+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:20.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:20.096+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:20.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:20.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:21.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:21.099+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:21.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:21.742+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:22.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:22.113+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:22.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:22.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:23.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:23.124+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:23.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:23.836+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:24.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:24.125+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:24.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:24.849+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:25.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:25.117+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:25.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:25.851+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:26.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:26.110+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:26.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:26.902+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:27.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:27.119+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:27.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:27.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:28.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:28.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:28.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:28.842+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:29.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:29.098+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:29.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:29.851+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:30.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:30.131+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:30.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:30.804+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:31.145 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:31.146+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:31.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:31.795+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:32.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:32.105+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:32.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:32.823+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:33.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:33.069+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:33.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:33.844+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:34.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:34.020+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:34.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:34.862+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:35.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:35.001+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:35.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:35.880+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:35.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:35.956+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:36.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:36.832+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:36.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:36.972+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:37.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:37.823+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:38.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:38.001+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:38.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:38.788+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:39.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:39.042+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:39.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:39.767+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:40.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:40.033+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:40.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:40.779+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:41.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:41.046+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:41.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:41.734+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:42.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:42.026+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:42.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:42.726+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:43.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:43.051+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:43.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:43.767+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:44.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:44.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:44.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:44.724+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:45.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:45.058+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:45.755 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:45.755+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:46.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:46.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:46.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:46.748+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:47.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:47.074+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:47.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:47.748+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:48.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:48.063+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:48.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:48.709+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:49.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:49.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:49.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:49.702+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:50.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:50.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:50.677 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:50.677+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:51.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:51.118+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:51.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:51.671+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:52.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:52.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:52.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:52.667+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:53.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:53.038+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:53.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:53.652+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:54.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:54.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:54.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:54.634+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:55.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:55.046+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:55.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:55.609+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:56.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:56.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:56.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:56.581+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:57.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:57.031+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:57.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:57.554+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:58.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:58.037+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:58.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:58.545+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:59.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:59.016+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:59.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:05:59.564+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:05:59.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:05:59.996+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:00.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:00.536+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:01.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:01.044+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:01.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:01.582+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:02.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:02.009+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:02.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:02.600+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:03.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:03.004+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:03.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:03.554+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:03.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:03.994+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:04.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:04.510+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:04.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:04.948+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:05.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:05.533+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:05.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:05.922+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:06.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:06.544+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:06.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:06.894+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:07.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:07.496+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:07.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:07.886+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:08.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:08.484+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:08.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:08.872+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:09.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:09.469+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:09.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:09.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:10.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:10.513+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:10.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:10.947+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:11.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:11.559+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:11.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:11.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:12.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:12.546+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:12.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:12.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:13.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:13.594+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:13.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:13.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:14.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:14.585+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:14.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:14.902+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:15.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:15.610+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:15.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:15.911+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:16.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:16.632+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:16.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:16.897+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:17.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:17.640+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:17.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:17.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:18.621 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:18.622+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:18.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:18.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:19.651 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:19.652+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:19.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:19.873+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:20.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:20.647+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:20.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:20.833+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:21.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:21.687+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:21.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:21.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:22.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:22.726+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:22.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:22.833+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:23.701 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:23.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:23.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:23.851+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:24.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:24.729+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:24.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:24.839+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:25.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:25.734+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:25.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:25.889+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:26.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:26.689+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:26.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:26.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:27.658 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:27.658+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:27.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:27.928+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:28.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:28.668+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:28.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:28.949+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:29.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:29.624+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:29.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:29.925+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:30.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:30.584+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:30.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:30.917+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:31.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:31.548+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:31.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:31.962+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:32.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:32.581+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:32.983 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:32.983+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:33.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:33.560+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:34.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:34.013+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:34.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:34.512+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:34.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:34.999+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:35.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:35.500+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:36.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:36.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:36.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:36.502+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:37.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:37.053+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:37.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:37.530+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:38.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:38.056+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:38.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:38.565+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:39.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:39.009+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:39.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:39.521+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:39.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:39.965+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:40.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:40.559+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:40.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:40.917+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:41.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:41.589+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:41.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:41.900+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:42.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:42.638+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:42.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:42.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:43.591 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:43.591+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:43.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:43.891+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:44.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:44.551+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:44.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:44.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:45.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:45.584+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:45.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:45.923+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:46.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:46.536+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:46.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:46.889+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:47.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:47.516+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:47.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:47.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:48.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:48.539+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:48.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:48.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:49.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:49.531+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:49.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:49.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:50.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:50.489+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:50.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:50.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:51.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:51.447+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:51.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:51.965+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:52.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:52.486+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:52.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:52.933+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:53.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:53.450+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:53.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:53.969+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:54.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:54.429+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:54.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:54.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:55.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:55.394+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:56.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:56.011+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:56.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:56.364+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:57.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:57.001+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:57.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:57.389+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:57.987 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:57.988+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:58.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:58.375+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:58.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:06:58.957+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:06:59.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:06:59.366+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:00.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:00.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:00.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:00.327+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:00.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:00.999+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:01.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:01.312+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:02.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:02.039+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:02.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:02.336+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:03.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:03.079+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:03.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:03.307+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:04.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:04.106+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:04.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:04.321+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:05.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:05.109+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:05.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:05.335+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:06.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:06.082+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:06.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:06.294+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:07.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:07.056+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:07.337 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:07.337+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:08.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:08.071+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:08.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:08.371+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:09.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:09.103+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:09.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:09.340+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:10.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:10.107+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:10.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:10.364+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:11.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:11.088+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:11.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:11.349+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:12.101 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:12.101+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:12.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:12.304+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:13.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:13.085+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:13.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:13.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:14.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:14.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:14.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:14.278+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:15.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:15.018+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:15.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:15.311+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:15.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:15.989+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:16.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:16.296+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:16.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:16.985+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:17.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:17.248+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:17.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:17.974+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:18.228 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:18.228+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:18.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:18.944+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:19.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:19.196+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:19.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:19.927+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:20.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:20.216+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:20.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:20.915+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:21.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:21.234+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:21.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:21.960+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:22.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:22.224+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:22.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:22.978+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:23.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:23.176+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:23.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:23.931+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:24.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:24.154+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:24.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:24.889+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:25.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:25.196+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:25.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:25.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:26.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:26.186+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:26.884 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:26.884+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:27.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:27.145+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:27.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:27.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:28.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:28.099+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:28.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:28.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:29.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:29.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:29.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:29.839+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:30.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:30.034+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:30.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:30.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:31.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:31.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:31.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:31.894+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:32.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:32.071+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:32.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:32.855+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:33.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:33.092+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:33.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:33.808+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:34.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:34.055+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:34.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:34.784+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:35.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:35.080+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:35.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:35.811+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:36.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:36.060+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:36.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:36.800+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:37.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:37.033+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:37.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:37.841+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:38.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:38.000+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:38.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:38.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:39.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:39.002+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:39.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:39.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:40.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:40.014+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:40.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:40.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:41.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:41.054+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:41.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:41.816+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:42.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:42.053+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:42.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:42.847+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:43.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:43.092+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:43.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:43.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:44.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:44.082+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:44.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:44.816+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:45.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:45.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:45.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:45.841+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:46.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:46.026+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:46.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:46.801+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:47.026 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:47.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:47.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:47.802+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:48.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:48.025+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:48.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:48.803+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:49.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:49.021+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:49.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:49.809+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:49.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:49.989+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:50.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:50.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:50.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:50.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:51.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:51.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:51.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:51.914+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:52.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:52.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:52.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:52.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:53.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:53.834+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:54.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:54.010+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:54.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:54.840+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:54.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:54.986+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:55.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:55.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:55.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:55.970+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:56.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:56.798+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:56.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:56.966+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:57.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:57.786+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:57.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:57.954+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:58.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:58.797+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:58.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:58.909+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:59.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:07:59.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:07:59.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:07:59.932+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:00.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:00.752+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:00.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:00.936+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:01.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:01.780+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:01.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:01.949+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:02.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:02.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:02.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:02.991+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:03.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:03.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:03.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:03.971+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:04.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:04.832+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:04.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:04.932+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:05.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:05.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:05.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:05.936+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:06.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:06.809+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:06.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:06.956+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:07.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:07.796+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:07.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:07.915+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:08.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:08.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:08.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:08.923+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:09.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:09.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:09.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:09.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:10.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:10.876+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:10.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:10.897+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:11.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:11.840+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:11.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:11.864+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:12.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:12.822+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:12.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:12.826+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:13.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:13.822+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:13.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:13.829+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:14.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:14.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:14.856 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:14.857+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:15.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:15.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:15.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:15.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:16.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:16.847+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:16.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:16.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:17.822 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:17.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:17.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:17.889+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:18.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:18.862+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:18.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:18.867+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:19.864 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:19.865+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:19.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:19.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:20.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:20.879+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:20.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:20.880+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:21.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:21.844+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:21.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:21.854+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:22.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:22.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:22.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:22.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:23.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:23.906+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:23.908 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:23.908+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:24.908 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:24.908+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:24.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:24.928+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:25.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:25.896+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:25.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:25.902+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:26.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:26.886+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:26.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:26.919+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:27.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:27.921+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:27.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:27.931+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:28.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:28.939+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:28.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:28.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:29.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:29.949+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:30.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:30.005+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:30.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:30.965+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:30.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:30.981+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:31.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:31.930+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:31.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:31.948+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:32.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:32.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:32.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:32.988+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:33.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:33.934+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:33.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:33.954+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:34.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:34.885+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:34.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:34.959+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:35.924 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:35.924+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:35.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:35.973+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:36.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:36.950+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:36.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:36.979+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:37.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:37.918+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:38.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:38.006+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:38.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:38.939+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:38.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:38.974+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:39.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:39.933+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:39.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:39.985+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:40.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:40.907+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:40.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:40.981+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:41.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:41.909+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:41.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:41.991+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:42.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:42.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:42.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:42.979+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:43.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:43.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:43.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:43.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:44.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:44.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:44.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:44.973+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:45.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:45.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:45.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:45.989+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:46.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:46.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:47.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:47.011+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:47.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:47.919+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:47.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:47.994+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:48.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:48.938+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:48.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:48.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:49.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:49.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:49.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:49.963+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:50.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:50.927+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:50.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:50.984+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:51.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:51.927+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:51.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:51.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:52.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:52.891+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:52.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:52.925+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:53.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:53.910+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:53.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:53.970+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:54.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:54.884+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:55.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:55.008+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:55.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:55.879+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:56.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:56.009+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:56.860 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:56.861+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:56.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:56.969+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:57.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:57.857+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:57.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:57.984+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:58.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:58.907+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:58.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:08:58.997+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:08:59.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:08:59.906+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:00.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:00.024+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:00.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:00.933+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:00.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:00.989+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:01.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:01.945+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:02.020 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:02.021+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:02.902 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:02.903+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:03.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:03.062+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:03.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:03.883+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:04.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:04.081+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:04.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:04.929+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:05.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:05.069+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:05.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:05.949+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:06.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:06.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:06.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:06.959+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:07.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:07.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:07.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:07.922+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:08.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:08.089+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:08.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:08.876+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:09.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:09.095+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:09.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:09.875+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:10.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:10.087+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:10.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:10.865+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:11.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:11.079+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:11.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:11.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:12.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:12.090+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:12.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:12.919+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:13.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:13.093+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:13.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:13.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:14.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:14.051+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:14.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:14.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:15.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:15.077+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:15.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:15.890+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:16.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:16.125+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:16.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:16.896+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:17.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:17.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:17.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:17.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:18.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:18.135+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:18.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:18.875+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:19.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:19.156+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:19.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:19.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:20.135 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:20.136+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:20.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:20.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:21.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:21.160+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:21.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:21.909+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:22.182 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:22.183+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:22.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:22.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:23.175 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:23.176+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:23.870 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:23.871+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:24.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:24.164+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:24.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:24.853+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:25.187 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:25.188+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:25.871 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:25.872+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:26.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:26.148+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:26.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:26.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:27.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:27.169+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:27.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:27.875+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:28.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:28.125+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:28.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:28.875+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:29.136 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:29.137+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:29.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:29.882+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:30.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:30.130+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:30.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:30.849+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:31.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:31.102+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:31.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:31.898+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:32.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:32.080+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:32.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:32.866+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:33.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:33.127+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:33.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:33.903+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:34.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:34.100+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:34.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:34.895+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:35.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:35.121+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:35.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:35.936+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:36.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:36.102+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:36.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:36.984+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:37.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:37.113+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:38.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:38.034+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:38.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:38.156+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:38.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:38.986+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:39.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:39.181+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:39.990 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:39.990+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:40.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:40.180+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:41.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:41.016+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:41.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:41.194+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:41.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:41.996+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:42.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:42.235+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:42.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:42.996+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:43.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:43.266+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:44.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:44.041+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:44.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:44.297+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:45.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:45.005+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:45.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:45.342+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:46.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:46.000+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:46.294 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:46.294+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:47.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:47.013+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:47.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:47.310+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:47.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:47.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:48.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:48.325+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:48.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:48.938+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:49.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:49.304+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:49.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:49.917+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:50.262 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:50.263+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:50.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:50.889+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:51.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:51.240+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:51.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:51.844+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:52.289 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:52.290+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:52.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:52.799+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:53.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:53.298+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:53.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:53.818+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:54.292 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:54.292+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:54.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:54.788+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:55.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:55.258+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:55.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:55.838+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:56.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:56.234+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:56.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:56.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:57.190 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:57.191+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:57.774 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:57.775+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:58.217 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:58.218+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:58.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:58.800+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:59.221 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:09:59.221+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:09:59.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:09:59.767+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:00.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:00.246+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:00.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:00.803+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:01.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:01.239+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:01.774 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:01.774+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:02.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:02.234+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:02.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:02.807+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:03.275 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:03.277+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:03.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:03.800+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:04.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:04.321+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:04.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:04.777+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:05.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:05.361+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:05.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:05.820+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:06.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:06.361+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:06.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:06.855+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:07.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:07.385+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:07.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:07.846+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:08.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:08.354+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:08.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:08.859+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:09.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:09.396+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:09.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:09.858+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:10.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:10.389+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:10.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:10.868+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:11.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:11.401+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:11.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:11.888+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:12.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:12.401+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:12.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:12.923+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:13.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:13.398+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:13.939 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:13.940+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:14.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:14.441+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:14.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:14.969+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:15.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:15.469+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:16.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:16.010+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:16.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:16.422+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:17.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:17.020+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:17.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:17.392+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:18.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:18.032+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:18.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:18.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:19.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:19.073+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:19.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:19.372+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:20.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:20.103+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:20.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:20.349+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:21.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:21.141+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:21.319 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:21.319+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:22.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:22.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:22.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:22.297+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:23.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:23.140+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:23.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:23.328+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:24.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:24.186+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:24.358 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:24.359+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:25.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:25.215+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:25.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:25.373+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:26.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:26.214+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:26.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:26.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:27.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:27.204+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:27.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:27.361+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:28.170 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:28.169+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:28.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:28.329+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:29.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:29.122+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:29.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:29.320+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:30.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:30.120+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:30.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:30.288+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:31.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:31.148+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:31.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:31.333+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:32.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:32.187+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:32.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:32.370+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:33.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:33.177+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:33.390 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:33.391+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:34.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:34.160+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:34.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:34.403+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:35.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:35.199+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:35.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:35.398+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:36.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:36.199+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:36.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:36.381+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:37.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:37.231+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:37.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:37.413+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:38.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:38.241+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:38.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:38.369+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:39.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:39.254+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:39.336 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:39.337+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:40.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:40.252+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:40.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:40.387+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:41.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:41.265+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:41.404 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:41.405+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:42.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:42.225+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:42.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:42.450+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:43.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:43.254+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:43.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:43.449+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:44.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:44.258+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:44.408 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:44.408+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:45.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:45.298+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:45.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:45.392+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:46.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:46.349+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:46.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:46.352+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:47.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:47.336+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:47.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:47.341+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:48.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:48.311+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:48.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:48.355+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:49.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:49.292+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:49.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:49.354+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:50.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:50.296+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:50.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:50.323+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:51.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:51.286+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:51.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:51.354+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:52.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:52.326+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:52.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:52.384+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:53.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:53.301+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:53.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:53.429+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:54.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:54.282+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:54.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:54.447+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:55.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:55.236+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:55.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:55.412+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:56.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:56.190+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:56.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:56.445+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:57.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:57.142+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:57.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:57.418+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:58.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:58.133+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:58.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:58.393+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:59.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:10:59.183+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:10:59.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:10:59.419+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:00.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:00.227+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:00.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:00.431+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:01.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:01.257+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:01.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:01.436+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:02.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:02.235+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:02.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:02.455+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:03.228 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:03.228+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:03.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:03.460+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:04.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:04.235+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:04.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:04.476+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:05.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:05.205+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:05.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:05.491+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:06.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:06.207+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:06.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:06.447+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:07.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:07.167+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:07.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:07.498+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:08.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:08.133+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:08.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:08.546+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:09.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:09.115+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:09.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:09.550+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:10.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:10.159+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:10.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:10.539+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:11.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:11.147+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:11.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:11.501+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:12.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:12.176+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:12.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:12.550+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:13.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:13.194+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:13.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:13.563+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:14.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:14.239+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:14.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:14.518+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:15.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:15.269+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:15.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:15.518+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:16.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:16.304+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:16.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:16.522+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:17.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:17.255+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:17.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:17.572+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:18.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:18.216+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:18.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:18.608+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:19.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:19.237+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:19.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:19.636+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:20.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:20.244+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:20.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:20.613+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:21.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:21.259+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:21.651 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:21.651+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:22.221 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:22.221+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:22.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:22.656+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:23.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:23.264+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:23.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:23.676+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:24.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:24.256+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:24.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:24.715+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:25.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:25.253+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:25.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:25.750+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:26.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:26.277+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:26.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:26.708+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:27.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:27.307+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:27.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:27.754+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:28.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:28.317+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:28.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:28.747+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:29.362 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:29.363+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:29.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:29.771+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:30.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:30.320+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:30.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:30.752+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:31.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:31.309+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:31.796 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:31.796+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:32.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:32.291+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:32.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:32.789+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:33.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:33.288+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:33.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:33.819+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:34.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:34.247+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:34.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:34.794+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:35.262 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:35.263+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:35.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:35.830+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:36.240 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:36.242+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:36.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:36.788+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:37.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:37.265+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:37.830 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:37.832+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:38.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:38.234+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:38.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:38.803+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:39.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:39.191+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:39.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:39.768+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:40.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:40.207+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:40.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:40.783+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:41.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:41.236+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:41.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:41.738+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:42.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:42.209+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:42.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:42.762+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:43.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:43.187+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:43.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:43.718+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:44.213 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:44.214+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:44.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:44.727+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:45.224 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:45.225+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:45.752 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:45.752+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:46.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:46.219+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:46.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:46.751+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:47.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:47.185+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:47.768 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:47.768+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:48.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:48.155+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:48.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:48.731+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:49.186 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:49.186+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:49.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:49.692+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:50.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:50.155+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:50.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:50.727+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:51.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:51.147+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:51.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:51.685+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:52.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:52.129+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:52.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:52.681+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:53.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:53.161+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:53.713 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:53.713+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:54.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:54.149+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:54.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:54.669+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:55.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:55.132+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:55.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:55.628+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:56.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:56.164+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:56.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:56.625+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:57.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:57.185+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:57.673 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:57.674+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:58.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:58.156+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:58.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:58.639+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:59.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:11:59.151+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:11:59.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:11:59.660+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:00.136 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:00.136+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:00.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:00.707+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:01.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:01.167+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:01.678 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:01.678+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:02.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:02.197+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:02.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:02.657+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:03.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:03.151+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:03.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:03.664+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:04.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:04.103+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:04.614 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:04.615+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:05.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:05.118+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:05.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:05.602+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:06.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:06.114+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:06.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:06.597+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:07.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:07.141+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:07.614 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:07.615+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:08.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:08.095+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:08.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:08.652+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:09.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:09.123+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:09.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:09.664+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:10.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:10.085+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:10.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:10.662+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:11.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:11.049+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:11.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:11.699+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:12.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:12.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:12.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:12.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:13.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:13.106+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:13.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:13.749+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:14.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:14.062+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:14.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:14.798+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:15.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:15.045+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:15.796 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:15.796+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:16.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:16.016+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:16.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:16.777+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:16.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:16.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:17.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:17.746+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:17.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:17.986+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:18.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:18.716+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:18.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:18.941+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:19.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:19.667+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:19.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:19.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:20.677 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:20.678+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:20.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:20.957+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:21.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:21.669+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:22.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:22.002+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:22.623 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:22.625+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:23.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:23.047+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:23.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:23.600+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:24.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:24.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:24.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:24.608+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:25.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:25.088+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:25.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:25.608+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:26.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:26.061+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:26.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:26.655+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:27.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:27.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:27.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:27.629+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:28.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:28.043+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:28.620 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:28.622+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:29.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:29.039+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:29.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:29.655+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:30.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:30.086+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:30.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:30.668+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:31.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:31.083+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:31.649 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:31.650+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:32.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:32.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:32.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:32.665+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:33.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:33.003+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:33.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:33.660+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:34.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:34.043+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:34.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:34.652+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:35.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:35.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:35.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:35.691+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:36.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:36.072+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:36.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:36.740+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:37.098 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:37.098+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:37.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:37.732+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:38.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:38.138+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:38.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:38.691+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:39.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:39.092+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:39.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:39.643+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:40.129 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:40.130+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:40.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:40.627+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:41.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:41.084+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:41.648 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:41.648+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:42.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:42.085+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:42.602 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:42.602+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:43.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:43.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:43.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:43.609+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:44.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:44.035+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:44.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:44.645+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:44.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:45.000+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:45.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:45.660+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:46.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:46.011+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:46.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:46.635+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:47.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:47.007+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:47.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:47.661+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:48.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:48.009+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:48.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:48.644+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:49.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:49.049+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:49.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:49.658+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:50.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:50.045+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:50.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:50.682+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:50.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:50.998+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:51.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:51.654+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:52.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:52.022+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:52.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:52.687+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:52.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:52.990+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:53.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:53.706+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:53.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:53.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:54.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:54.676+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:54.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:54.972+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:55.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:55.644+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:55.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:55.980+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:56.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:56.660+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:56.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:56.950+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:57.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:57.665+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:57.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:57.947+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:58.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:58.635+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:58.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:58.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:59.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:12:59.634+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:12:59.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:12:59.939+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:00.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:00.682+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:00.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:00.980+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:01.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:01.709+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:02.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:02.012+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:02.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:02.683+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:02.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:02.966+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:03.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:03.693+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:03.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:03.944+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:04.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:04.693+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:04.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:04.911+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:05.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:05.724+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:05.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:05.934+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:06.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:06.722+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:06.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:06.890+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:07.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:07.773+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:07.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:07.846+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:08.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:08.757+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:08.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:08.853+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:09.758 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:09.760+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:09.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:09.817+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:10.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:10.747+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:10.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:10.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:11.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:11.728+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:11.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:11.785+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:12.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:12.743+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:12.755 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:12.757+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:13.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:13.710+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:13.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:13.793+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:14.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:14.735+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:14.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:14.784+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:15.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:15.747+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:15.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:15.833+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:16.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:16.724+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:16.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:16.849+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:17.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:17.701+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:17.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:17.849+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:18.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:18.709+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:18.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:18.807+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:19.713 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:19.714+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:19.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:19.772+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:20.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:20.755+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:20.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:20.799+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:21.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:21.747+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:21.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:21.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:22.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:22.734+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:22.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:22.776+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:23.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:23.759+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:23.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:23.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:24.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:24.731+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:24.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:24.809+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:25.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:25.706+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:25.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:25.774+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:26.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:26.733+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:26.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:26.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:27.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:27.781+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:27.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:27.798+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:28.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:28.802+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:28.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:28.813+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:29.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:29.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:29.846 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:29.847+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:30.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:30.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:30.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:30.869+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:31.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:31.879+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:31.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:31.905+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:32.924 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:32.925+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:32.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:32.945+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:33.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:33.944+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:33.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:33.953+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:34.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:34.925+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:34.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:34.973+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:35.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:35.961+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:36.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:36.002+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:36.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:36.931+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:37.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:37.002+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:37.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:37.909+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:38.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:38.023+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:38.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:38.903+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:39.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:39.057+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:39.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:39.878+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:40.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:40.097+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:40.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:40.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:41.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:41.107+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:41.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:41.833+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:42.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:42.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:42.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:42.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:43.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:43.089+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:43.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:43.856+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:44.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:44.053+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:44.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:44.827+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:45.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:45.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:45.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:45.790+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:46.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:46.072+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:46.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:46.824+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:47.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:47.069+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:47.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:47.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:48.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:48.045+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:48.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:48.782+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:49.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:49.092+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:49.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:49.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:50.136 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:50.136+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:50.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:50.723+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:51.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:51.104+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:51.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:51.747+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:52.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:52.071+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:52.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:52.717+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:53.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:53.086+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:53.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:53.722+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:54.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:54.095+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:54.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:54.675+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:55.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:55.124+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:55.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:55.722+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:56.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:56.097+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:56.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:56.699+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:57.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:57.115+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:57.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:57.722+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:58.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:58.146+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:58.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:58.768+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:59.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:13:59.154+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:13:59.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:13:59.776+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:00.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:00.115+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:00.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:00.767+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:01.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:01.100+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:01.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:01.787+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:02.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:02.140+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:02.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:02.781+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:03.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:03.123+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:03.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:03.734+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:04.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:04.100+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:04.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:04.701+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:05.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:05.144+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:05.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:05.716+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:06.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:06.190+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:06.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:06.763+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:07.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:07.149+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:07.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:07.785+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:08.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:08.117+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:08.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:08.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:09.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:09.162+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:09.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:09.765+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:10.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:10.191+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:10.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:10.725+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:11.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:11.234+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:11.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:11.756+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:12.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:12.278+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:12.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:12.773+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:13.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:13.234+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:13.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:13.772+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:14.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:14.253+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:14.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:14.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:15.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:15.219+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:15.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:15.854+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:16.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:16.266+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:16.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:16.860+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:17.242 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:17.243+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:17.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:17.902+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:18.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:18.198+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:18.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:18.949+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:19.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:19.154+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:19.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:19.911+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:20.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:20.148+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:20.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:20.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:21.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:21.133+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:21.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:21.924+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:22.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:22.169+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:22.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:22.958+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:23.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:23.156+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:23.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:23.958+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:24.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:24.184+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:24.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:24.930+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:25.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:25.209+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:25.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:25.922+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:26.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:26.203+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:26.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:26.951+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:27.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:27.183+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:27.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:27.918+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:28.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:28.142+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:28.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:28.871+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:29.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:29.144+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:29.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:29.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:30.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:30.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:30.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:30.873+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:31.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:31.151+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:31.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:31.857+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:32.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:32.119+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:32.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:32.836+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:33.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:33.094+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:33.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:33.834+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:34.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:34.079+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:34.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:34.873+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:35.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:35.035+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:35.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:35.910+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:36.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:36.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:36.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:36.871+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:36.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:36.979+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:37.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:37.844+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:38.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:38.010+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:38.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:38.834+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:38.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:38.970+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:39.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:39.798+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:40.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:40.005+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:40.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:40.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:41.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:41.021+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:41.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:41.810+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:42.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:42.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:42.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:42.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:43.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:43.003+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:43.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:43.800+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:43.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:43.997+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:44.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:44.786+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:45.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:45.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:45.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:45.795+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:45.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:45.994+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:46.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:46.808+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:46.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:46.999+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:47.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:47.815+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:48.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:48.032+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:48.789 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:48.791+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:49.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:49.030+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:49.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:49.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:50.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:50.047+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:50.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:50.803+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:51.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:51.035+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:51.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:51.814+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:52.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:52.059+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:52.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:52.861+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:53.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:53.107+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:53.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:53.843+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:54.116 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:54.117+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:54.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:54.828+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:55.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:55.102+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:55.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:55.801+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:56.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:56.081+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:56.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:56.803+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:57.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:57.099+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:57.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:57.754+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:58.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:58.099+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:58.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:58.764+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:59.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:14:59.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:14:59.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:14:59.757+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:00.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:00.113+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:00.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:00.714+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:01.105 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:01.105+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:01.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:01.671+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:02.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:02.060+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:02.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:02.630+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:03.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:03.104+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:03.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:03.584+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:04.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:04.087+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:04.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:04.616+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:05.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:05.064+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:05.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:05.618+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:06.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:06.053+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:06.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:06.630+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:07.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:07.041+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:07.649 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:07.650+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:08.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:08.078+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:08.659 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:08.660+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:09.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:09.068+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:09.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:09.622+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:10.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:10.038+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:10.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:10.579+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:10.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:10.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:11.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:11.604+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:12.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:12.014+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:12.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:12.614+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:12.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:12.992+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:13.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:13.577+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:14.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:14.022+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:14.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:14.592+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:15.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:15.070+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:15.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:15.616+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:16.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:16.047+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:16.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:16.589+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:17.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:17.086+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:17.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:17.612+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:18.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:18.048+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:18.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:18.619+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:19.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:19.061+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:19.623 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:19.624+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:20.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:20.101+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:20.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:20.582+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:21.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:21.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:21.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:21.565+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:22.097 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:22.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:22.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:22.597+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:23.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:23.060+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:23.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:23.561+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:24.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:24.032+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:24.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:24.573+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:25.026 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:25.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:25.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:25.609+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:26.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:26.069+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:26.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:26.639+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:27.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:27.064+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:27.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:27.617+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:28.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:28.112+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:28.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:28.658+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:29.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:29.150+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:29.650 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:29.652+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:30.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:30.196+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:30.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:30.608+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:31.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:31.206+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:31.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:31.658+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:32.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:32.235+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:32.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:32.609+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:33.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:33.250+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:33.651 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:33.652+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:34.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:34.280+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:34.663 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:34.664+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:35.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:35.240+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:35.645 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:35.646+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:36.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:36.207+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:36.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:36.669+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:37.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:37.198+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:37.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:37.631+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:38.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:38.217+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:38.646 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:38.647+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:39.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:39.245+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:39.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:39.600+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:40.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:40.264+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:40.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:40.583+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:41.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:41.315+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:41.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:41.620+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:42.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:42.333+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:42.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:42.584+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:43.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:43.321+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:43.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:43.583+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:44.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:44.309+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:44.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:44.559+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:45.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:45.270+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:45.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:45.573+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:46.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:46.312+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:46.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:46.587+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:47.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:47.348+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:47.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:47.559+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:48.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:48.385+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:48.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:48.525+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:49.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:49.342+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:49.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:49.553+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:50.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:50.358+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:50.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:50.594+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:51.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:51.351+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:51.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:51.634+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:52.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:52.374+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:52.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:52.681+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:53.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:53.343+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:53.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:53.705+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:54.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:54.383+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:54.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:54.744+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:55.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:55.429+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:55.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:55.754+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:56.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:56.469+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:56.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:56.752+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:57.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:57.463+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:57.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:57.727+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:58.456 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:58.457+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:58.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:58.717+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:59.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:15:59.433+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:15:59.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:15:59.731+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:00.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:00.445+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:00.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:00.722+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:01.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:01.426+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:01.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:01.729+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:02.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:02.390+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:02.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:02.725+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:03.344 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:03.344+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:03.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:03.741+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:04.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:04.333+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:04.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:04.771+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:05.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:05.323+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:05.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:05.803+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:06.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:06.367+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:06.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:06.850+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:07.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:07.382+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:07.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:07.840+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:08.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:08.374+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:08.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:08.805+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:09.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:09.362+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:09.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:09.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:10.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:10.392+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:10.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:10.778+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:11.344 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:11.345+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:11.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:11.812+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:12.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:12.352+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:12.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:12.858+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:13.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:13.311+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:13.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:13.898+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:14.331 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:14.333+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:14.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:14.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:15.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:15.324+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:15.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:15.885+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:16.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:16.371+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:16.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:16.933+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:17.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:17.412+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:17.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:17.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:18.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:18.363+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:18.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:18.948+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:19.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:19.372+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:19.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:19.930+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:20.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:20.419+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:20.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:20.911+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:21.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:21.408+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:21.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:21.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:22.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:22.408+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:22.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:22.899+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:23.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:23.426+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:23.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:23.896+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:24.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:24.474+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:24.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:24.847+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:25.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:25.446+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:25.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:25.831+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:26.460 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:26.460+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:26.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:26.833+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:27.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:27.424+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:27.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:27.882+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:28.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:28.424+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:28.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:28.838+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:29.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:29.391+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:29.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:29.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:30.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:30.396+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:30.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:30.864+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:31.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:31.416+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:31.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:31.830+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:32.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:32.397+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:32.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:32.842+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:33.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:33.369+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:33.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:33.888+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:34.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:34.374+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:34.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:34.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:35.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:35.335+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:35.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:35.896+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:36.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:36.376+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:36.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:36.940+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:37.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:37.330+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:37.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:37.897+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:38.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:38.337+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:38.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:38.891+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:39.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:39.288+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:39.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:39.880+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:40.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:40.322+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:40.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:40.927+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:41.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:41.280+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:41.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:41.915+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:42.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:42.302+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:42.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:42.881+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:43.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:43.255+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:43.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:43.859+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:44.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:44.289+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:44.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:44.830+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:45.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:45.291+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:45.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:45.864+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:46.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:46.266+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:46.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:46.913+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:47.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:47.295+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:47.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:47.887+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:48.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:48.328+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:48.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:48.884+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:49.291 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:49.292+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:49.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:49.848+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:50.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:50.288+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:50.822 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:50.823+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:51.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:51.253+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:51.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:51.869+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:52.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:52.258+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:52.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:52.874+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:53.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:53.228+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:53.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:53.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:54.226 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:54.227+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:54.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:54.886+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:55.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:55.197+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:55.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:55.847+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:56.207 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:56.208+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:56.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:56.863+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:57.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:57.185+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:57.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:57.820+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:58.180 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:58.182+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:58.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:58.862+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:59.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:16:59.190+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:16:59.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:16:59.849+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:00.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:00.210+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:00.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:00.820+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:01.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:01.226+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:01.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:01.797+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:02.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:02.181+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:02.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:02.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:03.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:03.193+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:03.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:03.738+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:04.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:04.202+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:04.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:04.772+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:05.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:05.198+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:05.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:05.800+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:06.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:06.232+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:06.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:06.825+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:07.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:07.188+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:07.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:07.815+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:08.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:08.219+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:08.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:08.779+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:09.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:09.184+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:09.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:09.737+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:10.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:10.139+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:10.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:10.709+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:11.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:11.147+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:11.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:11.715+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:12.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:12.189+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:12.710 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:12.711+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:13.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:13.170+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:13.732 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:13.733+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:14.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:14.193+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:14.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:14.777+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:15.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:15.211+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:15.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:15.745+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:16.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:16.182+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:16.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:16.748+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:17.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:17.151+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:17.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:17.759+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:18.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:18.153+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:18.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:18.755+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:19.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:19.146+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:19.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:19.786+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:20.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:20.116+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:20.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:20.769+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:21.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:21.115+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:21.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:21.793+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:22.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:22.103+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:22.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:22.746+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:23.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:23.079+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:23.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:23.709+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:24.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:24.065+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:24.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:24.755+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:25.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:25.089+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:25.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:25.721+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:26.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:26.083+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:26.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:26.753+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:27.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:27.061+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:27.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:27.794+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:28.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:28.091+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:28.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:28.837+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:29.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:29.047+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:29.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:29.884+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:30.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:30.097+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:30.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:30.856+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:31.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:31.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:31.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:31.875+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:32.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:32.118+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:32.920 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:32.921+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:33.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:33.098+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:33.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:33.913+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:34.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:34.105+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:34.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:34.887+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:35.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:35.070+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:35.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:35.934+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:36.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:36.041+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:36.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:36.909+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:37.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:37.019+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:37.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:37.935+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:38.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:38.019+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:38.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:38.969+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:39.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:39.033+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:39.991 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:39.992+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:40.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:40.084+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:41.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:41.037+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:41.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:41.040+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:42.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:42.009+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:42.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:42.035+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:42.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:42.974+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:43.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:43.051+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:43.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:43.975+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:44.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:44.037+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:45.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:45.023+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:45.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:45.027+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:46.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:46.049+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:46.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:46.070+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:46.770 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T14:17:46.772+0000 7fcd7ebd3700 0 -- 172.21.15.69:0/2655470317 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x7fcd64034140 msgr2=0x7fcd64036520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T14:17:47.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:47.026+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:47.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:47.053+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:48.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:48.034+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:48.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:48.050+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:49.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:49.066+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:49.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:49.083+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:50.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:50.049+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:50.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:50.087+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:51.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:51.042+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:51.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:51.115+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:52.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:52.003+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:52.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:52.087+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:52.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:52.991+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:53.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:53.125+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:53.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:53.967+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:54.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:54.111+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:54.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:54.974+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:55.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:55.082+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:55.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:55.958+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:56.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:56.066+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:56.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:56.964+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:57.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:57.048+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:58.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:58.005+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:58.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:58.025+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:58.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:58.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:58.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:58.990+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:59.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:17:59.957+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:17:59.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:17:59.976+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:00.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:00.929+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:00.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:00.986+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:01.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:01.924+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:01.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:01.972+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:02.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:02.892+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:02.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:02.976+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:03.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:03.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:03.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:03.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:04.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:04.936+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:04.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:05.000+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:05.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:05.982+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:06.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:06.048+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:06.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:06.995+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:07.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:07.036+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:07.990 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:07.991+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:08.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:08.037+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:08.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:08.981+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:09.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:09.055+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:10.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:10.014+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:10.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:10.060+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:10.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:10.990+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:11.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:11.082+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:11.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:11.964+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:12.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:12.035+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:12.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:12.986+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:13.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:13.013+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:13.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:13.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:13.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:13.978+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:14.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:14.917+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:14.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:14.942+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:15.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:15.947+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:15.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:15.961+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:16.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:16.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:16.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:16.945+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:17.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:17.874+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:17.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:17.905+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:18.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:18.855+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:18.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:18.916+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:19.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:19.838+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:19.940 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:19.940+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:20.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:20.825+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:20.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:20.892+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:21.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:21.800+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:21.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:21.877+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:22.811 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:22.812+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:22.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:22.864+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:23.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:23.844+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:23.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:23.883+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:24.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:24.828+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:24.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:24.908+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:25.859 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:25.860+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:25.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:25.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:26.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:26.826+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:26.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:26.926+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:27.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:27.820+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:27.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:27.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:28.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:28.790+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:29.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:29.006+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:29.781 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:29.781+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:29.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:29.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:30.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:30.820+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:30.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:30.995+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:31.795 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:31.797+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:32.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:32.031+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:32.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:32.845+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:33.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:33.053+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:33.831 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:33.833+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:34.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:34.047+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:34.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:34.827+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:35.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:35.077+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:35.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:35.811+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:36.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:36.040+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:36.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:36.824+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:36.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:36.994+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:37.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:37.852+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:37.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:37.955+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:38.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:38.899+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:38.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:38.934+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:39.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:39.916+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:39.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:39.935+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:40.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:40.881+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:40.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:40.927+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:41.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:41.930+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:41.950 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:41.951+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:42.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:42.909+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:42.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:42.954+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:43.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:43.938+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:44.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:44.004+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:44.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:44.956+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:44.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:45.000+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:45.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:45.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:46.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:46.020+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:46.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:46.966+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:47.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:47.028+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:47.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:47.935+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:47.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:47.996+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:48.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:48.938+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:48.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:48.969+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:49.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:49.945+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:49.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:49.977+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:50.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:50.972+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:51.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:51.006+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:51.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:51.988+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:52.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:52.025+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:52.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:52.966+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:53.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:53.008+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:53.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:53.999+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:54.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:54.038+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:54.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:54.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:55.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:55.020+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:56.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:56.006+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:56.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:56.014+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:57.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:57.002+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:57.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:57.023+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:57.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:57.964+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:58.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:58.017+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:58.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:58.989+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:59.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:18:59.016+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:18:59.990 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:18:59.991+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:00.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:00.004+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:00.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:00.997+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:01.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:01.008+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:01.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:01.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:01.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:01.983+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:02.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:02.957+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:02.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:02.968+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:03.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:03.920+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:03.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:03.944+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:04.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:04.944+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:04.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:04.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:05.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:05.928+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:05.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:05.946+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:06.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:06.949+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:06.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:06.963+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:07.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:07.968+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:07.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:07.976+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:08.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:08.985+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:08.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:08.988+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:09.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:09.957+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:10.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:10.032+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:10.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:10.966+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:11.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:11.052+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:11.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:11.965+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:12.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:12.022+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:12.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:12.934+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:13.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:13.052+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:13.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:13.931+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:14.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:14.088+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:14.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:14.950+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:15.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:15.062+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:15.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:15.944+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:16.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:16.073+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:16.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:16.931+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:17.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:17.089+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:17.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:17.885+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:18.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:18.083+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:18.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:18.847+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:19.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:19.092+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:19.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:19.887+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:20.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:20.092+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:20.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:20.877+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:21.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:21.125+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:21.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:21.894+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:22.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:22.129+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:22.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:22.891+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:23.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:23.123+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:23.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:23.935+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:24.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:24.076+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:24.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:24.913+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:25.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:25.041+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:25.881 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:25.883+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:26.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:26.014+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:26.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:26.922+0000 7fab1f6c6700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:27.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:27.040+0000 7f96f0ee4700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:27.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:27.932+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:27.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:27.997+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:28.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:28.891+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:29.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:29.007+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:29.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:29.856+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:30.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:30.038+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:30.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:30.824+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:30.991 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:30.992+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:31.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:31.816+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:31.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:31.968+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:32.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:32.800+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:32.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:32.951+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:33.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:33.848+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:33.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:33.917+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:34.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:34.842+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:34.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:34.967+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:35.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:35.884+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:35.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:35.948+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:36.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:36.890+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:36.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:36.990+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:37.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:37.912+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:38.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:38.012+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:38.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:38.923+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:38.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:38.977+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:39.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:39.890+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:39.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:39.979+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:40.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:40.876+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:41.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:41.016+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:41.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:41.846+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:42.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:42.058+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:42.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:42.874+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:43.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:43.094+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:43.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:43.879+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:44.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:44.140+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:44.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:44.845+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:45.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:45.103+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:45.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:45.886+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:46.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:46.094+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:46.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:46.920+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:47.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:47.090+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:47.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:47.883+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:48.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:48.063+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:48.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:48.908+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:49.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:49.049+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:49.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:49.918+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:50.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:50.059+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:50.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:50.874+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:51.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:51.058+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:51.881 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:51.882+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:52.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:52.062+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:52.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:52.845+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:53.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:53.071+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:53.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:53.835+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:54.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:54.108+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:54.793 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:54.794+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:55.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:55.141+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:55.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:55.817+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:56.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:56.180+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:56.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:56.820+0000 7fab1f6c6700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:57.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:57.140+0000 7f96f0ee4700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:57.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:57.856+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:58.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:58.189+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:58.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:58.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:59.186 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:19:59.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:19:59.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:19:59.805+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:00.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:00.180+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:00.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:00.768+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:01.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:01.168+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:01.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:01.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:02.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:02.152+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:02.793 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:02.794+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:03.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:03.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:03.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:03.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:04.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:04.130+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:04.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:04.801+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:05.174 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:05.176+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:05.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:05.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:06.224 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:06.226+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:06.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:06.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:07.217 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:07.219+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:07.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:07.744+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:08.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:08.174+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:08.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:08.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:09.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:09.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:09.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:09.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:10.237 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:10.239+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:10.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:10.855+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:11.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:11.274+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:11.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:11.852+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:12.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:12.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:12.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:12.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:13.336 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:13.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:13.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:13.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:14.321 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:14.322+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:14.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:14.856+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:15.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:15.300+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:15.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:15.893+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:16.266 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:16.267+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:16.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:16.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:17.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:17.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:17.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:17.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:18.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:18.324+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:18.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:18.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:19.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:19.372+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:19.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:19.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:20.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:20.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:20.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:20.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:21.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:21.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:21.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:21.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:22.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:22.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:22.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:22.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:23.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:23.211+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:23.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:23.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:24.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:24.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:24.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:24.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:25.228 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:25.229+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:25.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:25.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:26.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:26.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:26.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:26.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:27.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:27.257+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:27.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:27.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:28.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:28.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:28.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:28.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:29.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:29.261+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:29.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:29.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:30.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:30.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:30.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:30.896+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:31.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:31.282+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:31.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:31.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:32.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:32.253+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:32.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:32.926+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:33.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:33.273+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:33.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:33.935+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:34.321 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:34.322+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:34.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:34.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:35.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:35.273+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:35.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:35.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:36.242 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:36.243+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:36.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:36.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:37.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:37.195+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:37.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:37.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:38.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:38.168+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:38.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:38.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:39.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:39.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:39.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:39.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:40.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:40.215+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:40.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:40.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:41.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:41.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:41.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:41.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:42.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:42.160+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:42.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:42.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:43.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:43.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:43.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:43.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:44.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:44.219+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:44.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:44.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:45.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:45.262+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:45.831 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:45.832+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:46.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:46.265+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:46.871 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:46.872+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:47.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:47.302+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:47.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:47.868+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:48.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:48.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:48.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:48.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:49.375 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:49.377+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:49.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:49.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:50.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:50.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:50.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:50.912+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:51.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:51.350+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:51.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:51.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:52.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:52.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:52.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:52.932+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:53.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:53.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:53.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:53.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:54.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:54.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:54.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:54.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:55.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:55.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:55.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:55.853+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:56.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:56.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:56.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:56.856+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:57.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:57.372+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:57.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:57.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:58.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:58.389+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:58.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:58.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:59.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:20:59.421+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:20:59.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:20:59.862+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:00.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:00.381+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:00.840 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:00.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:01.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:01.382+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:01.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:01.885+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:02.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:02.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:02.908 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:02.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:03.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:03.450+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:03.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:03.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:04.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:04.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:04.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:04.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:05.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:05.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:06.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:06.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:06.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:06.392+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:06.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:06.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:07.406 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:07.407+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:07.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:07.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:08.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:08.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:08.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:08.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:09.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:09.375+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:09.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:09.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:10.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:10.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:10.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:10.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:11.431 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:11.432+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:11.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:11.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:12.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:12.455+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:12.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:12.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:13.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:13.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:13.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:13.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:14.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:14.456+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:14.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:14.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:15.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:15.469+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:15.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:15.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:16.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:16.471+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:16.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:16.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:17.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:17.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:18.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:18.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:18.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:18.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:18.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:18.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:19.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:19.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:19.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:19.990+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:20.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:20.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:21.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:21.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:21.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:21.471+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:22.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:22.028+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:22.504 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:22.505+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:23.074 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:23.075+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:23.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:23.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:24.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:24.068+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:24.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:24.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:25.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:25.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:25.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:25.548+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:26.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:26.019+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:26.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:26.555+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:26.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:26.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:27.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:27.581+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:28.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:28.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:28.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:28.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:29.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:29.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:29.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:29.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:29.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:29.972+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:30.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:30.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:30.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:30.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:31.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:31.627+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:32.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:32.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:32.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:32.588+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:33.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:33.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:33.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:33.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:34.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:34.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:34.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:34.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:35.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:35.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:35.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:35.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:36.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:36.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:36.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:36.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:36.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:36.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:37.669 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:37.671+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:38.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:38.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:38.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:38.677+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:39.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:39.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:39.696 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:39.698+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:39.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:39.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:40.667 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:40.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:40.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:40.925+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:41.682 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:41.684+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:41.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:41.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:42.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:42.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:42.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:42.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:43.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:43.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:44.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:44.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:44.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:44.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:45.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:45.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:45.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:45.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:46.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:46.019+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:46.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:46.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:47.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:47.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:47.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:47.724+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:48.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:48.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:48.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:48.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:48.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:48.973+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:49.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:49.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:49.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:49.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:50.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:50.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:50.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:50.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:51.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:51.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:51.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:51.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:52.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:52.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:52.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:52.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:53.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:53.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:53.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:53.942+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:54.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:54.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:54.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:54.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:55.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:55.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:55.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:55.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:56.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:56.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:56.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:56.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:57.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:57.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:57.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:57.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:58.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:58.735+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:59.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:21:59.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:21:59.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:21:59.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:00.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:00.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:00.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:00.770+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:01.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:01.085+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:01.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:01.801+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:02.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:02.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:02.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:02.809+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:03.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:03.090+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:03.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:03.785+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:04.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:04.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:04.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:04.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:05.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:05.089+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:05.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:05.838+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:06.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:06.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:06.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:06.827+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:07.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:07.097+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:07.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:07.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:08.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:08.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:08.745 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:08.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:09.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:09.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:09.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:09.762+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:10.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:10.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:10.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:10.751+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:11.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:11.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:11.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:11.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:12.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:12.068+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:12.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:12.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:13.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:13.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:13.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:13.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:14.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:14.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:14.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:14.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:15.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:15.143+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:15.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:15.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:16.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:16.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:16.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:16.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:17.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:17.109+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:17.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:17.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:18.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:18.112+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:18.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:18.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:19.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:19.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:19.683 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:19.684+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:20.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:20.133+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:20.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:20.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:21.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:21.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:21.671 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:21.673+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:22.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:22.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:22.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:22.645+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:23.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:23.112+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:23.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:23.611+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:24.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:24.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:24.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:24.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:25.170 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:25.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:25.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:25.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:26.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:26.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:26.515 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:26.517+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:27.174 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:27.176+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:27.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:27.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:28.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:28.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:28.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:28.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:29.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:29.255+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:29.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:29.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:30.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:30.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:30.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:30.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:31.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:31.270+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:31.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:31.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:32.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:32.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:32.659 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:32.660+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:33.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:33.259+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:33.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:33.658+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:34.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:34.225+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:34.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:34.707+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:35.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:35.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:35.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:35.693+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:36.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:36.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:36.740 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:36.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:37.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:37.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:37.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:37.730+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:38.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:38.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:38.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:38.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:39.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:39.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:39.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:39.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:40.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:40.385+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:40.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:40.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:41.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:41.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:41.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:41.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:42.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:42.412+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:42.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:42.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:43.460 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:43.461+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:43.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:43.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:44.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:44.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:44.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:44.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:45.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:45.417+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:45.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:45.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:46.383 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:46.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:46.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:46.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:47.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:47.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:47.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:47.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:48.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:48.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:48.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:48.743+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:49.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:49.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:49.745 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:49.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:50.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:50.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:50.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:50.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:51.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:51.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:51.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:51.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:52.460 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:52.461+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:52.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:52.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:53.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:53.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:53.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:53.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:54.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:54.460+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:54.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:54.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:55.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:55.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:55.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:55.705+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:56.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:56.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:56.732 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:56.733+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:57.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:57.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:57.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:57.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:58.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:58.423+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:58.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:58.768+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:59.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:22:59.388+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:22:59.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:22:59.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:00.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:00.362+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:00.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:00.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:01.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:01.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:01.674 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:01.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:02.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:02.362+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:02.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:02.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:03.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:03.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:03.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:03.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:04.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:04.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:04.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:04.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:05.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:05.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:05.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:05.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:06.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:06.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:06.692 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:06.694+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:07.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:07.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:07.653 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:07.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:08.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:08.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:08.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:08.664+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:09.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:09.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:09.652 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:09.654+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:10.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:10.317+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:10.647 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:10.649+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:11.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:11.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:11.646 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:11.648+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:12.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:12.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:12.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:12.646+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:13.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:13.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:13.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:13.639+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:14.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:14.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:14.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:14.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:15.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:15.360+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:15.699 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:15.700+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:16.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:16.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:16.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:16.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:17.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:17.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:17.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:17.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:18.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:18.302+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:18.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:18.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:19.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:19.281+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:19.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:19.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:20.305 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:20.306+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:20.636 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:20.637+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:21.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:21.285+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:21.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:21.611+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:22.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:22.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:22.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:22.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:23.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:23.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:23.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:23.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:24.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:24.240+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:24.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:24.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:25.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:25.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:25.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:25.498+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:26.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:26.224+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:26.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:26.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:27.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:27.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:27.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:27.470+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:28.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:28.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:28.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:28.463+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:29.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:29.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:29.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:29.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:30.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:30.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:30.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:30.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:31.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:31.202+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:31.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:31.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:32.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:32.241+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:32.429 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:32.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:33.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:33.284+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:33.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:33.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:34.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:34.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:34.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:34.373+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:35.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:35.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:35.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:35.408+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:36.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:36.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:36.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:36.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:37.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:37.361+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:37.432 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:37.433+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:38.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:38.385+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:38.456 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:38.457+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:39.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:39.401+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:39.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:39.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:40.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:40.379+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:40.416 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:40.417+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:41.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:41.369+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:41.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:41.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:42.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:42.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:42.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:42.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:43.321 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:43.322+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:43.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:43.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:44.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:44.321+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:44.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:44.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:45.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:45.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:45.460 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:45.461+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:46.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:46.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:46.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:46.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:47.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:47.321+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:47.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:47.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:48.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:48.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:48.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:48.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:49.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:49.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:49.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:49.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:50.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:50.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:50.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:50.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:51.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:51.294+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:51.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:51.477+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:52.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:52.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:52.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:52.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:53.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:53.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:53.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:53.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:54.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:54.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:54.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:54.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:55.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:55.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:55.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:55.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:56.376 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:56.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:56.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:56.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:57.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:57.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:57.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:57.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:58.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:58.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:58.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:58.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:59.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:23:59.370+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:23:59.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:23:59.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:00.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:00.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:00.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:00.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:01.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:01.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:01.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:01.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:02.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:02.354+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:02.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:02.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:03.377 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:03.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:03.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:03.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:04.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:04.371+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:04.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:04.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:05.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:05.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:05.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:05.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:06.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:06.363+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:06.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:06.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:07.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:07.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:07.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:07.546+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:08.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:08.357+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:08.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:08.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:09.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:09.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:09.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:09.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:10.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:10.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:10.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:10.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:11.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:11.236+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:11.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:11.519+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:12.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:12.233+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:12.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:12.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:13.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:13.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:13.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:13.596+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:14.237 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:14.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:14.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:14.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:15.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:15.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:15.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:15.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:16.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:16.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:16.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:16.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:17.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:17.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:17.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:17.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:18.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:18.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:18.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:18.534+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:19.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:19.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:19.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:19.505+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:20.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:20.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:20.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:20.525+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:21.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:21.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:21.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:21.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:22.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:22.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:22.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:22.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:23.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:23.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:23.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:23.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:24.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:24.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:24.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:24.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:25.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:25.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:25.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:25.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:26.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:26.065+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:26.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:26.560+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:27.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:27.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:27.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:27.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:28.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:28.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:28.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:28.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:29.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:29.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:29.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:29.544+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:30.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:30.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:30.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:30.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:30.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:30.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:31.562 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:31.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:32.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:32.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:32.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:32.602+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:32.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:33.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:33.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:33.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:34.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:34.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:34.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:34.596+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:34.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:35.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:35.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:35.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:36.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:36.003+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:36.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:36.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:36.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:36.979+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:37.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:37.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:37.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:37.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:38.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:38.505+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:38.983 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:38.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:39.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:39.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:40.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:40.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:40.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:40.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:41.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:41.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:41.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:41.477+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:42.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:42.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:42.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:42.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:43.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:43.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:43.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:43.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:44.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:44.019+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:44.449 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:44.451+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:44.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:44.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:45.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:45.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:45.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:45.935+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:46.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:46.448+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:46.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:46.957+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:47.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:47.450+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:47.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:47.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:48.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:48.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:48.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:48.962+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:49.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:49.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:49.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:49.979+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:50.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:50.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:50.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:50.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:51.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:51.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:52.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:52.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:52.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:52.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:53.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:53.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:53.477 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:53.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:53.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:53.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:54.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:54.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:55.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:55.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:55.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:55.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:56.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:56.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:56.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:56.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:57.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:57.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:57.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:57.488+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:58.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:58.121+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:58.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:58.451+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:59.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:24:59.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:24:59.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:24:59.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:00.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:00.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:00.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:00.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:01.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:01.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:01.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:01.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:02.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:02.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:02.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:02.496+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:03.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:03.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:03.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:03.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:04.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:04.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:04.481 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:04.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:05.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:05.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:05.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:05.489+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:06.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:06.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:06.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:06.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:07.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:07.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:07.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:07.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:08.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:08.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:08.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:08.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:09.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:09.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:09.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:09.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:10.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:10.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:10.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:10.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:11.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:11.088+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:11.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:11.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:12.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:12.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:12.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:12.473+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:13.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:13.113+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:13.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:13.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:14.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:14.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:14.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:14.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:15.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:15.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:15.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:15.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:16.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:16.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:16.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:16.525+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:17.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:17.055+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:17.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:17.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:18.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:18.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:18.562 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:18.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:19.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:19.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:19.528 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:19.529+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:20.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:20.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:20.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:20.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:21.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:21.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:21.578 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:21.579+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:22.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:22.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:22.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:22.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:23.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:23.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:23.528 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:23.529+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:24.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:24.037+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:24.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:24.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:25.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:25.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:25.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:25.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:26.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:26.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:26.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:26.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:26.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:26.999+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:27.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:27.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:28.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:28.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:28.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:28.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:29.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:29.076+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:29.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:29.410+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:30.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:30.027+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:30.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:30.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:31.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:31.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:31.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:31.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:32.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:32.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:32.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:32.378+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:32.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:32.992+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:33.363 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:33.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:34.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:34.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:34.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:34.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:34.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:34.979+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:35.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:35.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:35.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:35.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:36.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:36.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:37.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:37.027+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:37.314 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:37.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:38.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:38.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:38.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:38.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:39.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:39.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:39.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:39.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:40.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:40.094+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:40.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:40.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:41.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:41.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:41.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:41.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:42.137 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:42.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:42.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:42.412+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:43.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:43.122+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:43.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:43.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:44.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:44.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:44.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:44.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:45.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:45.166+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:45.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:45.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:46.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:46.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:46.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:46.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:47.201 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:47.202+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:47.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:47.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:48.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:48.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:48.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:48.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:49.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:49.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:49.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:49.401+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:50.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:50.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:50.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:50.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:51.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:51.174+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:51.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:51.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:52.213 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:52.214+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:52.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:52.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:53.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:53.257+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:53.345 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:53.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:54.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:54.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:54.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:54.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:55.267 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:55.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:55.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:55.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:56.274 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:56.275+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:56.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:56.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:57.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:57.257+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:57.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:57.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:58.254 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:58.255+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:58.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:58.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:59.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:25:59.215+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:25:59.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:25:59.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:00.260 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:00.261+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:00.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:00.283+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:01.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:01.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:01.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:01.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:02.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:02.275+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:02.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:02.291+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:03.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:03.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:03.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:03.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:04.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:04.261+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:04.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:04.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:05.229 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:05.230+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:05.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:05.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:06.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:06.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:06.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:06.296+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:07.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:07.225+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:07.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:07.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:08.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:08.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:08.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:08.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:09.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:09.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:09.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:09.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:10.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:10.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:10.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:10.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:11.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:11.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:11.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:11.383+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:12.242 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:12.244+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:12.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:12.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:13.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:13.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:13.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:13.368+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:14.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:14.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:14.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:14.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:15.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:15.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:15.390 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:15.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:16.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:16.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:16.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:16.377+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:17.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:17.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:17.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:17.365+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:18.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:18.270+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:18.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:18.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:19.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:19.261+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:19.375 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:19.377+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:20.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:20.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:20.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:20.335+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:21.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:21.291+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:21.336 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:21.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:22.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:22.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:22.350 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:22.352+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:23.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:23.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:23.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:23.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:24.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:24.260+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:24.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:24.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:25.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:25.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:25.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:25.303+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:26.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:26.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:26.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:26.299+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:27.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:27.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:27.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:27.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:28.275 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:28.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:28.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:28.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:29.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:29.321+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:29.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:29.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:30.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:30.293+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:30.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:30.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:31.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:31.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:31.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:31.324+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:32.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:32.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:32.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:32.294+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:33.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:33.278+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:33.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:33.318+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:34.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:34.236+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:34.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:34.291+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:35.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:35.214+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:35.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:35.251+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:36.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:36.189+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:36.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:36.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:37.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:37.194+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:37.198 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:37.200+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:38.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:38.164+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:38.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:38.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:39.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:39.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:39.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:39.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:40.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:40.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:40.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:40.302+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:41.178 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:41.179+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:41.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:41.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:42.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:42.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:42.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:42.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:43.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:43.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:43.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:43.314+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:44.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:44.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:44.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:44.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:45.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:45.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:45.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:45.294+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:46.098 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:46.099+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:46.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:46.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:47.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:47.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:47.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:47.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:48.111 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:48.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:48.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:48.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:49.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:49.088+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:49.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:49.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:50.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:50.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:50.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:50.337+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:51.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:51.168+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:51.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:51.317+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:52.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:52.216+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:52.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:52.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:53.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:53.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:53.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:53.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:54.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:54.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:54.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:54.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:55.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:55.150+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:55.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:55.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:56.199 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:56.200+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:56.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:56.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:57.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:57.222+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:57.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:57.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:58.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:58.261+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:58.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:58.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:59.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:26:59.275+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:26:59.337 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:26:59.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:00.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:00.243+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:00.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:00.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:01.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:01.249+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:01.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:01.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:02.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:02.295+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:02.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:02.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:03.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:03.283+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:03.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:03.342+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:04.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:04.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:04.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:04.388+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:05.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:05.216+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:05.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:05.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:06.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:06.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:06.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:06.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:07.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:07.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:07.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:07.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:08.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:08.302+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:08.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:08.423+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:09.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:09.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:09.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:09.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:10.292 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:10.293+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:10.402 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:10.403+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:11.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:11.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:11.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:11.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:12.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:12.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:12.449 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:12.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:13.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:13.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:13.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:13.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:14.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:14.371+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:14.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:14.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:15.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:15.397+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:15.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:15.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:16.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:16.371+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:16.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:16.519+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:17.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:17.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:17.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:17.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:18.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:18.352+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:18.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:18.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:19.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:19.321+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:19.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:19.450+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:20.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:20.334+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:20.454 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:20.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:21.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:21.357+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:21.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:21.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:22.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:22.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:22.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:22.461+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:23.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:23.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:23.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:23.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:24.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:24.267+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:24.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:24.460+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:25.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:25.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:25.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:25.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:26.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:26.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:26.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:26.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:27.230 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:27.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:27.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:27.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:28.200 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:28.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:28.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:28.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:29.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:29.177+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:29.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:29.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:30.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:30.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:30.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:30.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:31.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:31.177+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:31.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:31.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:32.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:32.189+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:32.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:32.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:33.231 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:33.232+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:33.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:33.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:34.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:34.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:34.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:34.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:35.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:35.253+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:35.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:35.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:36.266 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:36.267+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:36.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:36.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:37.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:37.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:37.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:37.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:38.200 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:38.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:38.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:38.477+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:39.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:39.223+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:39.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:39.470+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:40.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:40.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:40.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:40.488+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:41.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:41.217+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:41.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:41.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:42.223 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:42.224+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:42.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:42.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:43.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:43.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:43.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:43.579+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:44.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:44.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:44.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:44.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:45.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:45.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:45.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:45.587+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:46.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:46.128+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:46.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:46.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:47.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:47.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:47.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:47.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:48.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:48.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:48.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:48.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:49.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:49.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:49.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:49.591+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:50.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:50.136+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:50.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:50.546+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:51.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:51.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:51.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:51.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:52.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:52.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:52.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:52.544+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:53.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:53.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:53.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:53.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:54.171 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:54.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:54.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:54.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:55.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:55.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:55.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:55.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:56.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:56.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:56.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:56.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:57.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:57.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:57.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:57.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:58.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:58.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:58.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:58.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:59.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:27:59.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:27:59.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:27:59.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:00.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:00.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:00.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:00.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:01.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:01.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:01.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:01.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:02.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:02.089+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:02.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:02.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:03.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:03.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:03.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:03.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:04.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:04.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:04.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:04.452+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:05.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:05.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:05.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:05.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:06.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:06.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:06.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:06.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:06.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:06.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:07.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:07.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:07.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:07.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:08.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:08.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:08.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:08.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:09.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:09.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:09.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:09.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:10.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:10.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:10.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:10.949+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:11.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:11.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:11.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:11.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:12.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:12.448+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:12.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:12.954+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:13.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:13.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:13.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:13.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:14.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:14.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:14.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:14.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:15.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:15.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:15.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:15.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:16.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:16.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:16.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:16.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:17.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:17.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:17.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:17.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:18.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:18.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:19.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:19.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:19.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:19.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:20.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:20.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:20.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:20.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:20.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:20.966+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:21.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:21.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:21.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:21.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:22.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:22.394+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:22.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:22.986+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:23.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:23.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:23.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:23.959+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:24.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:24.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:24.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:24.912+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:25.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:25.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:25.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:25.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:26.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:26.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:26.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:26.950+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:27.302 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:27.303+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:27.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:27.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:28.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:28.340+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:28.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:28.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:29.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:29.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:29.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:29.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:30.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:30.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:30.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:30.992+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:31.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:31.331+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:31.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:31.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:32.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:32.360+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:33.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:33.013+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:33.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:33.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:34.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:34.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:34.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:34.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:35.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:35.065+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:35.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:35.293+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:36.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:36.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:36.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:36.314+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:37.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:37.003+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:37.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:37.307+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:38.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:38.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:38.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:38.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:38.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:38.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:39.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:39.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:40.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:40.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:40.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:40.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:41.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:41.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:41.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:41.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:42.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:42.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:42.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:42.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:43.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:43.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:43.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:43.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:44.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:44.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:44.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:44.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:45.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:45.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:45.229 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:45.231+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:46.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:46.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:46.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:46.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:47.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:47.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:47.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:47.207+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:48.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:48.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:48.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:48.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:49.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:49.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:49.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:49.191+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:50.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:50.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:50.162 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:50.163+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:51.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:51.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:51.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:51.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:52.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:52.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:52.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:52.196+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:53.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:53.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:53.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:53.185+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:54.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:54.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:54.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:54.234+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:54.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:54.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:55.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:55.280+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:55.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:55.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:56.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:56.253+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:56.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:56.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:57.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:57.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:57.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:57.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:58.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:58.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:58.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:58.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:59.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:28:59.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:28:59.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:28:59.949+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:00.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:00.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:00.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:00.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:01.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:01.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:01.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:01.940+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:02.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:02.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:02.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:02.949+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:03.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:03.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:03.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:03.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:04.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:04.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:04.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:04.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:05.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:05.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:05.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:05.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:06.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:06.282+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:06.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:06.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:07.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:07.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:07.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:07.987+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:08.291 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:08.292+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:08.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:08.984+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:09.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:09.285+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:09.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:09.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:10.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:10.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:11.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:11.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:11.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:11.331+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:12.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:12.037+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:12.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:12.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:13.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:13.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:13.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:13.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:14.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:14.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:14.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:14.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:15.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:15.019+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:15.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:15.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:16.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:16.020+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:16.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:16.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:17.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:17.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:17.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:17.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:18.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:18.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:18.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:18.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:19.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:19.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:19.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:19.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:20.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:20.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:20.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:20.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:21.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:21.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:21.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:21.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:22.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:22.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:22.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:22.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:22.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:22.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:23.404 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:23.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:24.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:24.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:24.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:24.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:25.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:25.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:25.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:25.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:26.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:26.003+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:26.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:26.502+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:26.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:26.957+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:27.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:27.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:27.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:27.997+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:28.456 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:28.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:28.987 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:28.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:29.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:29.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:30.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:30.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:30.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:30.493+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:31.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:31.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:31.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:31.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:32.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:32.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:32.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:32.421+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:33.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:33.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:33.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:33.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:34.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:34.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:34.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:34.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:35.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:35.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:35.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:35.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:36.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:36.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:36.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:36.383+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:37.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:37.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:37.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:37.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:38.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:38.099+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:38.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:38.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:39.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:39.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:39.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:39.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:40.098 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:40.099+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:40.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:40.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:41.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:41.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:41.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:41.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:42.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:42.160+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:42.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:42.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:43.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:43.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:43.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:43.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:44.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:44.180+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:44.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:44.522+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:45.178 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:45.179+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:45.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:45.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:46.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:46.162+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:46.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:46.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:47.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:47.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:47.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:47.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:48.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:48.181+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:48.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:48.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:49.182 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:49.183+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:49.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:49.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:50.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:50.174+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:50.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:50.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:51.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:51.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:51.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:51.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:52.187 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:52.188+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:52.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:52.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:53.228 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:53.229+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:53.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:53.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:54.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:54.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:54.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:54.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:55.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:55.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:55.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:55.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:56.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:56.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:56.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:56.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:57.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:57.178+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:57.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:57.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:58.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:58.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:58.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:58.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:59.137 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:29:59.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:29:59.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:29:59.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:00.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:00.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:00.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:00.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:01.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:01.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:01.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:01.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:02.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:02.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:02.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:02.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:03.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:03.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:03.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:03.544+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:04.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:04.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:04.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:04.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:05.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:05.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:05.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:05.565+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:06.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:06.142+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:06.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:06.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:07.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:07.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:07.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:07.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:08.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:08.142+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:08.587 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:08.589+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:09.175 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:09.177+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:09.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:09.569+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:10.213 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:10.214+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:10.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:10.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:11.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:11.233+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:11.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:11.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:12.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:12.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:12.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:12.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:13.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:13.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:13.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:13.555+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:14.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:14.223+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:14.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:14.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:15.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:15.186+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:15.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:15.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:16.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:16.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:16.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:16.534+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:17.174 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:17.176+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:17.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:17.506+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:18.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:18.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:18.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:18.541+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:19.157 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:19.158+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:19.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:19.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:20.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:20.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:20.579 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:20.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:21.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:21.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:21.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:21.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:22.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:22.186+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:22.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:22.593+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:23.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:23.204+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:23.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:23.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:24.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:24.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:24.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:24.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:25.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:25.178+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:25.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:25.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:26.199 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:26.200+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:26.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:26.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:27.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:27.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:27.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:27.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:28.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:28.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:28.454 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:28.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:29.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:29.173+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:29.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:29.470+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:30.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:30.220+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:30.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:30.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:31.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:31.239+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:31.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:31.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:32.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:32.208+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:32.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:32.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:33.199 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:33.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:33.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:33.541+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:34.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:34.152+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:34.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:34.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:35.190 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:35.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:35.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:35.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:36.231 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:36.232+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:36.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:36.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:37.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:37.223+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:37.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:37.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:38.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:38.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:38.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:38.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:39.157 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:39.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:39.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:39.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:40.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:40.121+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:40.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:40.565+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:41.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:41.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:41.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:41.586+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:42.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:42.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:42.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:42.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:43.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:43.100+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:43.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:43.560+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:44.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:44.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:44.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:44.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:45.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:45.106+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:45.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:45.605+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:46.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:46.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:46.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:46.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:47.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:47.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:47.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:47.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:48.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:48.160+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:48.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:48.590+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:49.195 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:49.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:49.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:49.615+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:50.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:50.191+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:50.588 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:50.589+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:51.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:51.225+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:51.621 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:51.623+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:52.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:52.228+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:52.639 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:52.641+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:53.275 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:53.277+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:53.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:53.688+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:54.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:54.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:54.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:54.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:55.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:55.324+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:55.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:55.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:56.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:56.363+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:56.728 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:56.729+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:57.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:57.329+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:57.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:57.689+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:58.294 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:58.295+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:58.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:58.649+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:59.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:30:59.329+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:30:59.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:30:59.681+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:00.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:00.289+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:00.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:00.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:01.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:01.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:01.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:01.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:02.337 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:02.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:02.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:02.654+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:03.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:03.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:03.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:03.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:04.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:04.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:04.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:04.685+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:05.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:05.352+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:05.696 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:05.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:06.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:06.397+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:06.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:06.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:07.362 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:07.363+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:07.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:07.762+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:08.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:08.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:08.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:08.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:09.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:09.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:09.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:09.760+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:10.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:10.348+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:10.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:10.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:11.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:11.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:11.758 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:11.759+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:12.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:12.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:12.752 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:12.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:13.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:13.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:13.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:13.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:14.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:14.312+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:14.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:14.826+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:15.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:15.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:15.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:15.870+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:16.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:16.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:16.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:16.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:17.376 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:17.377+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:17.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:17.875+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:18.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:18.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:18.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:18.921+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:19.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:19.326+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:19.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:19.890+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:20.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:20.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:20.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:20.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:21.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:21.273+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:21.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:21.894+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:22.275 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:22.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:22.860 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:22.861+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:23.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:23.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:23.824 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:23.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:24.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:24.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:24.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:24.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:25.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:25.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:25.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:25.837+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:26.289 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:26.290+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:26.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:26.866+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:27.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:27.262+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:27.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:27.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:28.258 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:28.259+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:28.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:28.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:29.230 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:29.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:29.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:29.899+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:30.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:30.262+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:30.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:30.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:31.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:31.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:31.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:31.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:32.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:32.274+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:32.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:32.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:33.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:33.260+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:33.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:33.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:34.242 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:34.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:34.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:34.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:35.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:35.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:35.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:35.937+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:36.231 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:36.233+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:36.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:36.928+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:37.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:37.211+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:37.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:37.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:38.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:38.255+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:38.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:38.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:39.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:39.270+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:39.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:39.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:40.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:40.236+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:41.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:41.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:41.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:41.228+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:41.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:41.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:42.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:42.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:42.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:42.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:43.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:43.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:44.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:44.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:44.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:44.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:44.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:44.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:45.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:45.236+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:46.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:46.025+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:46.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:46.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:46.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:46.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:47.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:47.266+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:47.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:47.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:48.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:48.299+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:48.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:48.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:49.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:49.310+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:49.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:49.923+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:50.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:50.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:50.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:50.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:51.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:51.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:51.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:51.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:52.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:52.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:52.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:52.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:53.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:53.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:54.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:54.001+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:54.319 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:54.320+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:55.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:55.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:55.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:55.369+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:56.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:56.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:56.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:56.335+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:56.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:56.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:57.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:57.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:57.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:57.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:58.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:58.348+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:58.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:58.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:59.350 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:31:59.351+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:31:59.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:31:59.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:00.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:00.384+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:00.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:00.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:01.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:01.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:01.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:01.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:02.398 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:02.399+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:02.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:02.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:03.408 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:03.410+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:04.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:04.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:04.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:04.427+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:04.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:04.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:05.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:05.451+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:05.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:05.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:06.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:06.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:07.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:07.003+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:07.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:07.363+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:07.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:07.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:08.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:08.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:08.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:08.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:09.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:09.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:09.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:09.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:10.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:10.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:10.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:10.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:11.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:11.220+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:12.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:12.028+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:12.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:12.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:12.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:12.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:13.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:13.236+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:14.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:14.014+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:14.254 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:14.255+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:14.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:14.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:15.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:15.278+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:16.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:16.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:16.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:16.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:17.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:17.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:17.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:17.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:18.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:18.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:18.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:18.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:19.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:19.074+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:19.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:19.270+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:20.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:20.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:20.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:20.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:21.061 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:21.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:21.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:21.200+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:22.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:22.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:22.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:22.206+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:23.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:23.014+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:23.201 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:23.203+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:24.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:24.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:24.211 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:24.213+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:25.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:25.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:25.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:25.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:26.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:26.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:26.269 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:26.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:27.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:27.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:27.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:27.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:27.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:27.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:28.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:28.267+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:28.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:28.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:29.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:29.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:29.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:29.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:30.240 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:30.241+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:30.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:30.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:31.213 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:31.215+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:32.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:32.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:32.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:32.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:33.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:33.019+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:33.266 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:33.267+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:33.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:34.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:34.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:34.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:34.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:34.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:35.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:35.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:35.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:35.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:36.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:36.273+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:36.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:36.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:37.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:37.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:37.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:37.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:38.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:38.354+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:38.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:38.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:39.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:39.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:39.939 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:39.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:40.337 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:40.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:40.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:40.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:41.358 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:41.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:41.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:41.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:42.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:42.317+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:42.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:42.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:43.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:43.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:44.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:44.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:44.294 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:44.295+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:45.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:45.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:45.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:45.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:46.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:46.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:46.262 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:46.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:47.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:47.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:47.242 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:47.243+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:47.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:47.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:48.269 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:48.271+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:48.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:48.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:49.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:49.312+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:49.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:49.973+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:50.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:50.288+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:50.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:50.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:51.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:51.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:51.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:51.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:52.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:52.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:52.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:52.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:53.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:53.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:53.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:53.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:54.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:54.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:54.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:54.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:55.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:55.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:55.838 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:55.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:56.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:56.357+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:56.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:56.827+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:57.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:57.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:57.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:57.865+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:58.438 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:58.440+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:58.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:58.879+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:59.466 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:32:59.467+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:32:59.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:32:59.846+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:00.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:00.449+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:00.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:00.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:01.408 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:01.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:01.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:01.917+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:02.439 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:02.441+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:02.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:02.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:03.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:03.394+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:03.838 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:03.840+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:04.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:04.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:04.836 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:04.838+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:05.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:05.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:05.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:05.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:06.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:06.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:06.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:06.820+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:07.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:07.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:07.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:07.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:08.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:08.455+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:08.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:08.843+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:09.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:09.424+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:09.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:09.855+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:10.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:10.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:10.869 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:10.872+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:11.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:11.486+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:11.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:11.890+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:12.438 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:12.440+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:12.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:12.884+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:13.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:13.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:13.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:13.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:14.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:14.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:14.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:14.875+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:15.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:15.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:15.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:15.842+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:16.503 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:16.504+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:16.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:16.818+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:17.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:17.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:17.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:17.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:18.506 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:18.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:18.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:18.805+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:19.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:19.535+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:19.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:19.799+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:20.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:20.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:20.838 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:20.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:21.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:21.571+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:21.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:21.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:22.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:22.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:22.860 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:22.861+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:23.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:23.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:23.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:23.846+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:24.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:24.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:24.876 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:24.877+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:25.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:25.593+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:25.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:25.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:26.623 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:26.625+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:26.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:26.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:27.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:27.657+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:27.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:27.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:28.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:28.625+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:28.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:28.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:29.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:29.581+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:29.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:29.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:30.537 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:30.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:30.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:30.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:31.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:31.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:31.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:31.947+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:32.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:32.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:32.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:32.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:33.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:33.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:33.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:33.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:34.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:34.619+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:34.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:34.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:35.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:35.633+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:35.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:35.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:36.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:36.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:37.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:37.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:37.618 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:37.619+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:38.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:38.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:38.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:38.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:39.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:39.086+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:39.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:39.615+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:40.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:40.069+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:40.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:40.639+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:41.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:41.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:41.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:41.682+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:42.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:42.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:42.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:42.657+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:43.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:43.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:43.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:43.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:44.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:44.179+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:44.671 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:44.673+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:45.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:45.203+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:45.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:45.660+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:46.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:46.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:46.649 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:46.650+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:47.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:47.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:47.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:47.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:48.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:48.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:48.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:48.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:49.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:49.248+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:49.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:49.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:50.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:50.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:50.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:50.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:51.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:51.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:51.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:51.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:52.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:52.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:52.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:52.646+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:53.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:53.290+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:53.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:53.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:54.282 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:54.285+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:54.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:54.590+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:55.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:55.240+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:55.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:55.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:56.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:56.232+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:56.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:56.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:57.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:57.240+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:57.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:57.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:58.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:58.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:58.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:58.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:59.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:33:59.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:33:59.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:33:59.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:00.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:00.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:00.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:00.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:01.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:01.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:01.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:01.594+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:02.314 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:02.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:02.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:02.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:03.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:03.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:03.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:03.615+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:04.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:04.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:04.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:04.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:05.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:05.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:05.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:05.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:06.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:06.248+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:06.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:06.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:07.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:07.264+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:07.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:07.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:08.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:08.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:08.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:08.600+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:09.323 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:09.325+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:09.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:09.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:10.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:10.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:10.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:10.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:11.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:11.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:11.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:11.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:12.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:12.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:12.646 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:12.648+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:13.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:13.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:13.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:13.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:14.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:14.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:14.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:14.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:15.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:15.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:15.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:15.618+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:16.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:16.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:16.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:16.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:17.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:17.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:17.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:17.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:18.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:18.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:18.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:18.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:19.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:19.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:19.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:19.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:20.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:20.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:20.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:20.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:21.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:21.360+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:21.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:21.556+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:22.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:22.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:22.526 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:22.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:23.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:23.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:23.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:23.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:24.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:24.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:24.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:24.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:25.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:25.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:25.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:25.581+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:26.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:26.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:26.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:26.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:27.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:27.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:27.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:27.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:28.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:28.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:28.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:28.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:29.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:29.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:29.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:29.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:30.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:30.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:30.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:30.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:31.337 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:31.338+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:31.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:31.593+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:32.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:32.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:32.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:32.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:33.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:33.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:33.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:33.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:34.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:34.283+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:34.515 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:34.518+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:35.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:35.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:35.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:35.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:36.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:36.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:36.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:36.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:37.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:37.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:37.486 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:37.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:38.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:38.280+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:38.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:38.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:39.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:39.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:39.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:39.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:40.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:40.287+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:40.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:40.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:41.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:41.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:41.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:41.504+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:42.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:42.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:42.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:42.471+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:43.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:43.306+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:43.494 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:43.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:44.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:44.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:44.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:44.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:45.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:45.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:45.475 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:45.477+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:46.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:46.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:46.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:46.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:47.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:47.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:47.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:47.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:48.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:48.347+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:48.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:48.438+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:49.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:49.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:49.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:49.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:50.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:50.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:50.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:50.464+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:51.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:51.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:51.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:51.437+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:52.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:52.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:52.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:52.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:53.482 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:53.483+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:53.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:53.490+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:54.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:54.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:54.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:54.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:55.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:55.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:55.486 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:55.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:56.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:56.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:56.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:56.469+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:57.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:57.432+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:57.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:57.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:58.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:58.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:58.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:58.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:59.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:34:59.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:34:59.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:34:59.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:00.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:00.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:00.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:00.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:01.398 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:01.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:01.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:01.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:02.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:02.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:02.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:02.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:03.404 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:03.406+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:03.525 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:03.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:04.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:04.410+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:04.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:04.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:05.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:05.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:05.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:05.518+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:06.429 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:06.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:06.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:06.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:07.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:07.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:07.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:07.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:08.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:08.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:08.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:08.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:09.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:09.531+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:09.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:09.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:10.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:10.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:10.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:10.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:11.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:11.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:11.575 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:11.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:12.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:12.554+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:12.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:12.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:13.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:13.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:13.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:13.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:14.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:14.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:14.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:14.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:15.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:15.583+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:15.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:15.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:16.562 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:16.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:16.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:16.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:17.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:17.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:17.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:17.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:18.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:18.575+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:18.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:18.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:19.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:19.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:19.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:19.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:20.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:20.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:20.644 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:20.645+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:21.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:21.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:21.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:21.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:22.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:22.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:22.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:22.622+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:23.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:23.586+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:23.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:23.624+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:24.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:24.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:24.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:24.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:25.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:25.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:25.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:25.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:26.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:26.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:26.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:26.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:27.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:27.450+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:27.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:27.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:28.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:28.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:28.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:28.581+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:29.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:29.519+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:29.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:29.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:30.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:30.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:30.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:30.610+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:31.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:31.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:31.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:31.584+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:32.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:32.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:32.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:32.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:33.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:33.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:33.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:33.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:34.490 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:34.491+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:34.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:34.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:35.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:35.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:35.503 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:35.505+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:36.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:36.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:36.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:36.471+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:37.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:37.442+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:37.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:37.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:38.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:38.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:38.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:38.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:39.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:39.450+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:39.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:39.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:40.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:40.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:40.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:40.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:41.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:41.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:41.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:41.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:42.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:42.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:42.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:42.516+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:43.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:43.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:43.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:43.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:44.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:44.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:44.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:44.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:45.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:45.529+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:45.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:45.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:46.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:46.525+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:46.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:46.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:47.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:47.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:47.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:47.600+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:48.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:48.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:48.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:48.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:49.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:49.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:49.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:49.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:50.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:50.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:50.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:50.514+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:51.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:51.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:51.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:51.518+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:52.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:52.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:52.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:52.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:53.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:53.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:53.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:53.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:54.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:54.574+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:54.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:54.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:55.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:55.554+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:55.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:55.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:56.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:56.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:56.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:56.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:57.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:57.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:57.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:57.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:58.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:58.573+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:58.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:58.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:59.579 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:35:59.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:35:59.649 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:35:59.650+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:00.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:00.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:00.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:00.672+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:01.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:01.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:01.623 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:01.624+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:02.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:02.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:02.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:02.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:03.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:03.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:03.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:03.681+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:04.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:04.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:04.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:04.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:05.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:05.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:05.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:05.717+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:06.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:06.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:06.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:06.681+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:07.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:07.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:07.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:07.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:08.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:08.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:08.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:08.696+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:09.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:09.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:09.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:09.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:10.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:10.566+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:10.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:10.763+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:11.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:11.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:11.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:11.766+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:12.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:12.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:12.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:12.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:13.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:13.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:13.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:13.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:14.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:14.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:14.674 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:14.677+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:15.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:15.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:15.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:15.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:16.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:16.561+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:16.732 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:16.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:17.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:17.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:17.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:17.772+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:18.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:18.530+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:18.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:18.820+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:19.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:19.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:19.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:19.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:20.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:20.587+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:20.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:20.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:21.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:21.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:21.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:21.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:22.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:22.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:22.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:22.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:23.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:23.595+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:23.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:23.883+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:24.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:24.575+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:24.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:24.923+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:25.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:25.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:25.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:25.894+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:26.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:26.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:26.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:26.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:27.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:27.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:27.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:27.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:28.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:28.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:28.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:28.908+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:29.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:29.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:29.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:29.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:30.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:30.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:30.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:30.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:31.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:31.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:31.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:31.914+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:32.456 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:32.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:32.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:32.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:33.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:33.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:33.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:33.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:34.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:34.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:34.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:34.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:35.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:35.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:35.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:35.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:36.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:36.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:36.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:36.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:37.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:37.513+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:37.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:37.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:38.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:38.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:38.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:38.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:39.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:39.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:39.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:39.909+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:40.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:40.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:40.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:40.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:41.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:41.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:41.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:41.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:42.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:42.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:42.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:42.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:43.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:43.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:43.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:43.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:44.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:44.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:44.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:44.940+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:45.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:45.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:45.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:45.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:46.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:46.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:46.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:46.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:47.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:47.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:47.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:47.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:48.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:48.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:48.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:48.987+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:49.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:49.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:50.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:50.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:50.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:50.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:51.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:51.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:51.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:51.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:52.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:52.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:52.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:52.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:52.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:52.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:53.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:53.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:54.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:54.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:54.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:54.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:55.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:55.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:55.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:55.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:56.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:56.019+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:56.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:56.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:57.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:57.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:57.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:57.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:58.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:58.077+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:58.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:58.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:59.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:36:59.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:36:59.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:36:59.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:00.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:00.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:00.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:00.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:00.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:00.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:01.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:01.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:01.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:01.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:02.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:02.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:02.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:02.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:03.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:03.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:03.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:03.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:04.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:04.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:04.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:04.928+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:05.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:05.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:05.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:05.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:06.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:06.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:06.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:06.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:07.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:07.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:07.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:07.935+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:08.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:08.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:08.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:08.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:09.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:09.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:09.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:09.898+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:10.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:10.462+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:10.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:10.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:11.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:11.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:11.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:11.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:12.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:12.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:12.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:12.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:13.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:13.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:13.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:13.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:14.454 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:14.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:14.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:14.863+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:15.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:15.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:15.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:15.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:16.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:16.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:16.787 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:16.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:17.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:17.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:17.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:17.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:18.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:18.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:18.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:18.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:19.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:19.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:19.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:19.841+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:20.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:20.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:20.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:20.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:21.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:21.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:21.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:21.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:22.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:22.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:22.924 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:22.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:23.398 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:23.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:23.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:23.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:24.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:24.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:24.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:24.894+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:25.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:25.351+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:25.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:25.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:26.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:26.308+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:26.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:26.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:27.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:27.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:27.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:27.854+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:28.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:28.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:28.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:28.824+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:29.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:29.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:29.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:29.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:30.305 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:30.306+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:30.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:30.809+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:31.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:31.336+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:31.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:31.835+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:32.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:32.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:32.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:32.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:33.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:33.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:33.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:33.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:34.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:34.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:34.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:34.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:35.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:35.280+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:35.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:35.787+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:36.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:36.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:36.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:36.812+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:37.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:37.337+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:37.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:37.768+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:38.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:38.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:38.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:38.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:39.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:39.317+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:39.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:39.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:40.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:40.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:40.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:40.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:41.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:41.283+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:41.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:41.846+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:42.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:42.238+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:42.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:42.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:43.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:43.235+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:43.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:43.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:44.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:44.271+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:44.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:44.790+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:45.305 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:45.307+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:45.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:45.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:46.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:46.292+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:46.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:46.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:47.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:47.293+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:47.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:47.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:48.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:48.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:48.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:48.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:49.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:49.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:49.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:49.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:50.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:50.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:50.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:50.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:51.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:51.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:51.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:51.783+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:52.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:52.290+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:52.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:52.770+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:53.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:53.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:53.740 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:53.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:54.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:54.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:54.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:54.700+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:55.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:55.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:55.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:55.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:56.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:56.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:56.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:56.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:57.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:57.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:57.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:57.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:58.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:58.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:58.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:58.743+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:59.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:37:59.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:37:59.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:37:59.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:00.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:00.345+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:00.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:00.809+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:01.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:01.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:01.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:01.822+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:02.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:02.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:02.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:02.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:03.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:03.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:03.867 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:03.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:04.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:04.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:04.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:04.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:05.404 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:05.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:05.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:05.953+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:06.424 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:06.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:06.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:06.927+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:07.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:07.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:07.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:07.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:08.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:08.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:08.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:08.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:09.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:09.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:09.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:09.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:10.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:10.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:10.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:10.950+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:11.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:11.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:11.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:11.996+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:12.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:12.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:13.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:13.015+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:13.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:13.337+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:14.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:14.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:14.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:14.308+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:15.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:15.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:15.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:15.314+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:16.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:16.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:16.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:16.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:17.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:17.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:17.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:17.281+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:18.174 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:18.175+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:18.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:18.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:19.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:19.152+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:19.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:19.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:20.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:20.129+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:20.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:20.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:21.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:21.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:21.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:21.231+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:22.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:22.053+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:22.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:22.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:23.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:23.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:23.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:23.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:24.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:24.015+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:24.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:24.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:25.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:25.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:25.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:25.302+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:26.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:26.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:26.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:26.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:27.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:27.077+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:27.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:27.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:28.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:28.098+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:28.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:28.243+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:29.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:29.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:29.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:29.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:30.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:30.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:30.207 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:30.209+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:31.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:31.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:31.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:31.202+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:32.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:32.048+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:32.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:32.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:33.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:33.079+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:33.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:33.239+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:34.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:34.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:34.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:34.250+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:35.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:35.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:35.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:35.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:36.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:36.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:36.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:36.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:37.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:37.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:37.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:37.321+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:38.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:38.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:38.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:38.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:39.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:39.091+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:39.323 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:39.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:40.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:40.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:40.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:40.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:41.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:41.148+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:41.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:41.385+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:42.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:42.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:42.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:42.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:43.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:43.152+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:43.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:43.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:44.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:44.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:44.344 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:44.345+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:45.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:45.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:45.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:45.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:46.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:46.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:46.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:46.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:47.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:47.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:47.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:47.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:48.228 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:48.229+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:48.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:48.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:49.217 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:49.218+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:49.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:49.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:50.169 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:50.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:50.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:50.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:51.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:51.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:51.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:51.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:52.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:52.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:52.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:52.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:53.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:53.186+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:53.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:53.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:54.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:54.208+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:54.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:54.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:55.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:55.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:55.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:55.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:56.175 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:56.177+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:56.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:56.388+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:57.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:57.136+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:57.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:57.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:58.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:58.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:58.378 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:58.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:59.115 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:38:59.117+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:38:59.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:38:59.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:00.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:00.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:00.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:00.424+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:01.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:01.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:01.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:01.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:02.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:02.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:02.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:02.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:03.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:03.092+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:03.402 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:03.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:04.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:04.052+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:04.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:04.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:05.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:05.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:05.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:05.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:05.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:05.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:06.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:06.466+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:06.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:06.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:07.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:07.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:07.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:07.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:08.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:08.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:08.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:08.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:09.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:09.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:10.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:10.021+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:10.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:10.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:10.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:11.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:11.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:11.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:11.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:11.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:12.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:12.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:12.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:12.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:13.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:13.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:13.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:13.898+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:14.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:14.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:14.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:14.862+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:15.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:15.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:15.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:15.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:16.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:16.379+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:16.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:16.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:17.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:17.370+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:17.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:17.874+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:18.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:18.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:18.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:18.838+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:19.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:19.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:19.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:19.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:20.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:20.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:20.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:20.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:21.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:21.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:21.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:21.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:22.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:22.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:22.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:22.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:23.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:23.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:23.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:23.965+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:24.404 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:24.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:24.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:24.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:25.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:25.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:25.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:25.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:26.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:26.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:26.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:26.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:27.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:27.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:27.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:27.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:28.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:28.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:28.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:28.986+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:29.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:29.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:29.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:29.954+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:30.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:30.403+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:30.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:30.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:31.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:31.383+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:31.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:31.960+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:32.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:32.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:32.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:32.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:33.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:33.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:33.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:33.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:34.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:34.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:34.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:34.999+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:35.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:35.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:36.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:36.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:36.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:36.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:37.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:37.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:37.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:37.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:38.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:38.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:38.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:38.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:39.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:39.128+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:39.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:39.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:40.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:40.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:40.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:40.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:41.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:41.157+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:41.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:41.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:42.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:42.169+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:42.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:42.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:43.187 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:43.188+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:43.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:43.470+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:44.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:44.183+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:44.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:44.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:45.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:45.228+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:45.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:45.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:46.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:46.189+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:46.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:46.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:47.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:47.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:47.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:47.408+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:48.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:48.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:48.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:48.361+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:49.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:49.244+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:49.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:49.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:50.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:50.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:50.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:50.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:51.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:51.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:51.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:51.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:52.228 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:52.230+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:52.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:52.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:53.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:53.249+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:53.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:53.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:54.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:54.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:54.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:54.283+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:55.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:55.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:55.292 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:55.294+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:56.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:56.290+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:56.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:56.300+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:57.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:57.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:57.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:57.290+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:58.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:58.275+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:58.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:58.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:59.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:39:59.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:39:59.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:39:59.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:00.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:00.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:00.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:00.253+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:01.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:01.200+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:01.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:01.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:02.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:02.237+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:02.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:02.290+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:03.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:03.216+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:03.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:03.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:04.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:04.180+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:04.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:04.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:05.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:05.153+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:05.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:05.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:06.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:06.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:06.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:06.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:07.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:07.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:07.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:07.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:08.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:08.118+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:08.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:08.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:09.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:09.156+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:09.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:09.421+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:10.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:10.184+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:10.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:10.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:11.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:11.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:11.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:11.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:12.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:12.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:12.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:12.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:13.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:13.121+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:13.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:13.448+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:14.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:14.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:14.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:14.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:15.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:15.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:15.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:15.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:16.098 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:16.099+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:16.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:16.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:17.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:17.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:17.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:17.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:18.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:18.103+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:18.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:18.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:19.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:19.062+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:19.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:19.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:20.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:20.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:20.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:20.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:21.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:21.120+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:21.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:21.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:22.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:22.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:22.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:22.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:23.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:23.169+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:23.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:23.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:24.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:24.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:24.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:24.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:25.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:25.175+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:25.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:25.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:26.211 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:26.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:26.528 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:26.530+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:27.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:27.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:27.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:27.575+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:28.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:28.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:28.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:28.615+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:29.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:29.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:29.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:29.601+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:30.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:30.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:30.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:30.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:31.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:31.262+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:31.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:31.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:32.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:32.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:32.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:32.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:33.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:33.310+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:33.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:33.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:34.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:34.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:34.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:34.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:35.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:35.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:35.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:35.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:36.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:36.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:36.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:36.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:37.299 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:37.300+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:37.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:37.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:38.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:38.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:38.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:38.602+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:39.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:39.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:39.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:39.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:40.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:40.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:40.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:40.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:41.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:41.326+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:41.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:41.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:42.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:42.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:42.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:42.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:43.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:43.283+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:43.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:43.568+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:44.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:44.316+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:44.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:44.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:45.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:45.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:45.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:45.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:46.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:46.237+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:46.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:46.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:47.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:47.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:47.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:47.620+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:48.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:48.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:48.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:48.612+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:49.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:49.250+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:49.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:49.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:50.291 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:50.293+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:50.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:50.692+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:51.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:51.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:51.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:51.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:52.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:52.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:52.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:52.729+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:53.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:53.237+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:53.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:53.739+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:54.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:54.265+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:54.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:54.724+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:55.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:55.267+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:55.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:55.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:56.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:56.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:56.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:56.727+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:57.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:57.251+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:57.701 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:57.702+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:58.249 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:58.251+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:58.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:58.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:59.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:40:59.237+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:40:59.636 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:40:59.637+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:00.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:00.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:00.590 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:00.592+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:01.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:01.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:01.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:01.574+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:02.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:02.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:02.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:02.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:03.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:03.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:03.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:03.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:04.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:04.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:04.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:04.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:05.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:05.360+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:05.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:05.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:06.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:06.367+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:06.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:06.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:07.367 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:07.368+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:07.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:07.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:08.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:08.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:08.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:08.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:09.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:09.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:09.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:09.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:10.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:10.352+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:10.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:10.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:11.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:11.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:11.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:11.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:12.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:12.354+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:12.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:12.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:13.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:13.351+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:13.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:13.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:14.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:14.335+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:14.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:14.541+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:15.319 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:15.320+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:15.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:15.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:16.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:16.357+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:16.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:16.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:17.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:17.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:17.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:17.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:18.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:18.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:18.575 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:18.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:19.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:19.422+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:19.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:19.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:20.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:20.424+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:20.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:20.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:21.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:21.439+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:21.584 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:21.586+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:22.447 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:22.449+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:22.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:22.599+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:23.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:23.473+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:23.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:23.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:24.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:24.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:24.649 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:24.651+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:25.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:25.540+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:25.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:25.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:26.555 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:26.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:26.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:26.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:27.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:27.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:27.719 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:27.721+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:28.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:28.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:28.691 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:28.693+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:29.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:29.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:29.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:29.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:30.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:30.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:30.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:30.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:31.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:31.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:31.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:31.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:32.526 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:32.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:32.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:32.670+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:33.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:33.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:33.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:33.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:34.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:34.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:34.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:34.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:35.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:35.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:35.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:35.696+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:36.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:36.634+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:36.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:36.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:37.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:37.588+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:37.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:37.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:38.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:38.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:38.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:38.700+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:39.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:39.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:39.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:39.670+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:40.555 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:40.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:40.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:40.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:41.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:41.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:41.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:41.667+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:42.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:42.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:42.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:42.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:43.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:43.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:43.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:43.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:44.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:44.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:44.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:44.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:45.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:45.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:45.526 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:45.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:46.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:46.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:46.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:46.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:47.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:47.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:47.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:47.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:48.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:48.470+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:48.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:48.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:49.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:49.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:49.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:49.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:50.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:50.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:50.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:50.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:51.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:51.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:51.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:51.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:52.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:52.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:52.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:52.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:53.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:53.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:53.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:53.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:54.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:54.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:54.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:54.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:55.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:55.593+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:55.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:55.634+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:56.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:56.625+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:56.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:56.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:57.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:57.648+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:57.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:57.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:58.650 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:58.651+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:58.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:58.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:59.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:41:59.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:41:59.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:41:59.681+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:00.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:00.644+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:00.692 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:00.693+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:01.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:01.676+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:01.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:01.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:02.645 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:02.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:02.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:02.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:03.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:03.609+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:03.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:03.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:04.605 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:04.606+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:04.682 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:04.684+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:05.591 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:05.592+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:05.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:05.663+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:06.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:06.583+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:06.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:06.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:07.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:07.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:07.665 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:07.666+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:08.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:08.596+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:08.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:08.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:09.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:09.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:09.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:09.658+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:10.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:10.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:10.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:10.619+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:11.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:11.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:11.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:11.604+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:12.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:12.627+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:12.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:12.649+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:13.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:13.624+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:13.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:13.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:14.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:14.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:14.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:14.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:15.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:15.648+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:15.647 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:15.649+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:16.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:16.626+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:16.639 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:16.642+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:17.614 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:17.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:17.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:17.660+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:18.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:18.663+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:18.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:18.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:19.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:19.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:19.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:19.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:20.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:20.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:20.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:20.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:21.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:21.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:21.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:21.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:22.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:22.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:22.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:22.717+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:23.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:23.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:23.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:23.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:24.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:24.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:24.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:24.805+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:25.623 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:25.625+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:25.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:25.800+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:26.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:26.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:26.836 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:26.838+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:27.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:27.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:27.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:27.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:28.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:28.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:28.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:28.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:29.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:29.593+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:29.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:29.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:30.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:30.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:30.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:30.939+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:31.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:31.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:31.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:31.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:32.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:32.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:32.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:32.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:33.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:33.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:33.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:33.935+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:34.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:34.555+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:34.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:34.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:35.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:35.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:35.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:35.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:36.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:36.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:36.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:36.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:37.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:37.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:38.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:38.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:38.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:38.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:39.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:39.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:39.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:39.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:40.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:40.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:40.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:40.627+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:41.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:41.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:41.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:41.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:42.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:42.081+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:42.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:42.581+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:43.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:43.071+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:43.544 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:43.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:44.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:44.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:44.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:44.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:45.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:45.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:45.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:45.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:46.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:46.038+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:46.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:46.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:47.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:47.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:47.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:47.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:48.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:48.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:48.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:48.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:49.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:49.042+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:49.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:49.555+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:50.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:50.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:50.522 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:50.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:51.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:51.042+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:51.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:51.489+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:52.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:52.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:52.447 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:52.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:52.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:52.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:53.418 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:53.419+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:53.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:53.947+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:54.459 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:54.460+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:54.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:54.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:55.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:55.477+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:55.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:55.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:56.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:56.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:56.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:56.844+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:57.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:57.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:57.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:57.847+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:58.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:58.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:58.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:58.835+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:59.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:42:59.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:42:59.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:42:59.846+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:00.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:00.450+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:00.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:00.855+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:01.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:01.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:01.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:01.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:02.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:02.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:02.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:02.837+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:03.439 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:03.442+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:03.846 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:03.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:04.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:04.464+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:04.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:04.857+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:05.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:05.487+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:05.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:05.851+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:06.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:06.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:06.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:06.820+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:07.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:07.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:07.831 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:07.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:08.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:08.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:08.793 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:08.794+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:09.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:09.462+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:09.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:09.791+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:10.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:10.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:10.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:10.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:11.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:11.431+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:11.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:11.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:12.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:12.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:12.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:12.803+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:13.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:13.371+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:13.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:13.801+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:14.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:14.415+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:14.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:14.767+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:15.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:15.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:15.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:15.748+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:16.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:16.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:16.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:16.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:17.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:17.429+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:17.752 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:17.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:18.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:18.473+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:18.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:18.803+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:19.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:19.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:19.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:19.803+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:20.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:20.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:20.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:20.824+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:21.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:21.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:21.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:21.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:22.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:22.491+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:22.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:22.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:23.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:23.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:23.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:23.852+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:24.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:24.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:24.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:24.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:25.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:25.540+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:25.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:25.847+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:26.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:26.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:26.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:26.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:27.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:27.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:27.842 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:27.843+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:28.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:28.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:28.859 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:28.860+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:29.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:29.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:29.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:29.884+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:30.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:30.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:30.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:30.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:31.544 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:31.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:31.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:31.834+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:32.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:32.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:32.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:32.877+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:33.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:33.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:33.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:33.846+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:34.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:34.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:34.807 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:34.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:35.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:35.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:35.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:35.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:36.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:36.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:36.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:36.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:37.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:37.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:37.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:37.866+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:38.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:38.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:38.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:38.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:39.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:39.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:39.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:39.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:40.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:40.548+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:40.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:40.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:41.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:41.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:41.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:41.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:42.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:42.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:42.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:42.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:43.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:43.611+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:44.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:44.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:44.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:44.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:44.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:44.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:45.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:45.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:46.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:46.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:46.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:46.584+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:47.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:47.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:47.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:47.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:48.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:48.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:48.559 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:48.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:49.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:49.090+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:49.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:49.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:50.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:50.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:50.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:50.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:51.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:51.077+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:51.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:51.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:52.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:52.081+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:52.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:52.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:53.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:53.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:53.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:53.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:54.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:54.097+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:54.592 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:54.594+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:55.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:55.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:55.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:55.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:56.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:56.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:56.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:56.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:57.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:57.140+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:57.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:57.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:58.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:58.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:58.618 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:58.619+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:59.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:43:59.095+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:43:59.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:43:59.644+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:00.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:00.102+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:00.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:00.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:01.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:01.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:01.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:01.671+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:02.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:02.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:02.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:02.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:03.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:03.129+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:03.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:03.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:04.174 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:04.176+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:04.789 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:04.791+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:05.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:05.210+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:05.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:05.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:06.207 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:06.209+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:06.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:06.798+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:07.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:07.185+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:07.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:07.830+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:08.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:08.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:08.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:08.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:09.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:09.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:09.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:09.864+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:10.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:10.217+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:10.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:10.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:11.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:11.187+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:11.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:11.854+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:12.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:12.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:12.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:12.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:13.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:13.215+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:13.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:13.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:14.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:14.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:14.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:14.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:15.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:15.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:15.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:15.873+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:16.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:16.259+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:16.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:16.837+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:17.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:17.248+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:17.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:17.802+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:18.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:18.281+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:18.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:18.814+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:19.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:19.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:19.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:19.820+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:20.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:20.282+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:20.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:20.811+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:21.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:21.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:21.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:21.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:22.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:22.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:22.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:22.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:23.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:23.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:23.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:23.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:24.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:24.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:24.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:24.829+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:25.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:25.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:25.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:25.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:26.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:26.267+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:26.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:26.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:27.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:27.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:27.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:27.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:28.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:28.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:28.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:28.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:29.270 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:29.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:29.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:29.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:30.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:30.283+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:30.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:30.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:31.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:31.242+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:31.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:31.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:32.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:32.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:32.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:32.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:33.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:33.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:33.867 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:33.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:34.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:34.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:34.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:34.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:35.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:35.360+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:35.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:35.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:36.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:36.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:36.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:36.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:37.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:37.388+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:37.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:37.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:38.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:38.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:38.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:38.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:39.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:39.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:39.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:39.863+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:40.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:40.370+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:40.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:40.835+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:41.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:41.410+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:41.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:41.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:42.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:42.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:42.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:42.829+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:43.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:43.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:43.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:43.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:44.481 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:44.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:44.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:44.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:45.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:45.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:45.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:45.899+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:46.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:46.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:46.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:46.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:47.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:47.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:47.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:47.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:48.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:48.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:48.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:48.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:49.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:49.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:49.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:49.917+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:50.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:50.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:50.959 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:50.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:51.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:51.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:51.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:51.914+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:52.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:52.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:52.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:52.940+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:53.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:53.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:53.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:53.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:54.562 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:54.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:54.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:54.908+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:55.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:55.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:55.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:55.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:56.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:56.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:56.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:56.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:57.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:57.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:57.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:57.838+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:58.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:58.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:58.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:58.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:59.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:44:59.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:44:59.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:44:59.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:00.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:00.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:00.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:00.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:01.620 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:01.622+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:01.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:01.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:02.636 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:02.637+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:02.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:02.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:03.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:03.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:03.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:03.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:04.648 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:04.650+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:04.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:04.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:05.615 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:05.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:05.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:05.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:06.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:06.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:06.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:06.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:07.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:07.681+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:07.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:07.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:08.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:08.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:08.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:08.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:09.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:09.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:09.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:09.923+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:10.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:10.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:10.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:10.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:11.673 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:11.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:11.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:11.860+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:12.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:12.707+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:12.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:12.827+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:13.725 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:13.727+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:13.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:13.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:14.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:14.695+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:14.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:14.765+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:15.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:15.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:15.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:15.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:16.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:16.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:16.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:16.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:17.615 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:17.616+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:17.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:17.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:18.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:18.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:18.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:18.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:19.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:19.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:19.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:19.813+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:20.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:20.667+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:20.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:20.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:21.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:21.649+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:21.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:21.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:22.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:22.633+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:22.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:22.873+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:23.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:23.604+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:23.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:23.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:24.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:24.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:24.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:24.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:25.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:25.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:25.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:25.922+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:26.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:26.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:26.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:26.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:27.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:27.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:27.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:27.884+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:28.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:28.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:28.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:28.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:29.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:29.506+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:29.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:29.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:30.481 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:30.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:30.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:30.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:31.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:31.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:31.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:31.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:32.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:32.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:32.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:32.830+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:33.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:33.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:33.864 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:33.865+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:34.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:34.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:34.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:34.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:35.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:35.525+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:35.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:35.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:36.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:36.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:36.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:36.831+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:37.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:37.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:37.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:37.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:38.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:38.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:38.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:38.894+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:39.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:39.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:39.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:39.873+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:40.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:40.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:40.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:40.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:41.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:41.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:41.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:41.927+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:42.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:42.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:42.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:42.948+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:43.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:43.362+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:43.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:43.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:44.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:44.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:44.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:44.923+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:45.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:45.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:45.950 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:45.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:46.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:46.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:46.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:46.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:47.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:47.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:48.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:48.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:48.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:48.466+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:48.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:48.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:49.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:49.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:49.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:49.990+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:50.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:50.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:51.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:51.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:51.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:51.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:52.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:52.052+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:52.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:52.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:53.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:53.048+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:53.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:53.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:54.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:54.003+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:54.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:54.448+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:54.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:54.966+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:55.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:55.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:55.920 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:55.922+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:56.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:56.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:56.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:56.953+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:57.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:57.378+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:57.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:57.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:58.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:58.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:58.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:58.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:59.323 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:45:59.325+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:45:59.884 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:45:59.885+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:00.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:00.331+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:00.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:00.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:01.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:01.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:01.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:01.900+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:02.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:02.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:02.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:02.915+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:03.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:03.424+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:03.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:03.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:04.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:04.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:04.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:04.894+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:05.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:05.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:05.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:05.859+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:06.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:06.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:06.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:06.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:07.460 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:07.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:07.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:07.820+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:08.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:08.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:08.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:08.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:09.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:09.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:09.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:09.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:10.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:10.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:10.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:10.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:11.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:11.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:11.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:11.809+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:12.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:12.408+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:12.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:12.856+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:13.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:13.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:13.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:13.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:14.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:14.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:14.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:14.817+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:15.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:15.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:15.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:15.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:16.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:16.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:16.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:16.831+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:17.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:17.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:17.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:17.783+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:18.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:18.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:18.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:18.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:19.590 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:19.591+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:19.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:19.767+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:20.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:20.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:20.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:20.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:21.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:21.584+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:21.707 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:21.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:22.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:22.573+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:22.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:22.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:23.562 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:23.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:23.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:23.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:24.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:24.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:24.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:24.713+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:25.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:25.541+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:25.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:25.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:26.590 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:26.591+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:26.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:26.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:27.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:27.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:27.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:27.777+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:28.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:28.649+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:28.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:28.771+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:29.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:29.647+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:29.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:29.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:30.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:30.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:30.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:30.782+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:31.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:31.619+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:31.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:31.818+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:32.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:32.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:32.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:32.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:33.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:33.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:33.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:33.884+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:34.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:34.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:34.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:34.860+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:35.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:35.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:35.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:35.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:36.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:36.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:36.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:36.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:37.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:37.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:37.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:37.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:38.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:38.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:38.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:38.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:39.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:39.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:39.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:39.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:40.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:40.554+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:40.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:40.820+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:41.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:41.513+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:41.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:41.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:42.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:42.544+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:42.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:42.766+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:43.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:43.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:43.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:43.785+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:44.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:44.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:44.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:44.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:45.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:45.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:45.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:45.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:46.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:46.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:46.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:46.763+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:47.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:47.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:47.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:47.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:48.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:48.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:48.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:48.773+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:49.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:49.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:49.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:49.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:50.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:50.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:50.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:50.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:51.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:51.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:51.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:51.759+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:52.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:52.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:52.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:52.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:53.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:53.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:53.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:53.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:54.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:54.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:54.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:54.745+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:55.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:55.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:55.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:55.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:56.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:56.417+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:56.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:56.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:57.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:57.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:57.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:57.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:58.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:58.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:58.674 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:58.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:59.344 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:46:59.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:46:59.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:46:59.724+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:00.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:00.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:00.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:00.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:01.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:01.336+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:01.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:01.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:02.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:02.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:02.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:02.672+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:03.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:03.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:03.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:03.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:04.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:04.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:04.678 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:04.680+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:05.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:05.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:05.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:05.634+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:06.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:06.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:06.645 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:06.647+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:07.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:07.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:07.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:07.656+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:08.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:08.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:08.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:08.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:09.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:09.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:09.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:09.645+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:10.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:10.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:10.653 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:10.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:11.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:11.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:11.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:11.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:12.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:12.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:12.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:12.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:13.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:13.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:13.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:13.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:14.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:14.490+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:14.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:14.657+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:15.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:15.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:15.664 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:15.665+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:16.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:16.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:16.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:16.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:17.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:17.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:17.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:17.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:18.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:18.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:18.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:18.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:19.562 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:19.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:19.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:19.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:20.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:20.596+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:20.671 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:20.673+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:21.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:21.637+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:21.653 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:21.654+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:22.645 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:22.647+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:22.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:22.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:23.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:23.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:23.685 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:23.686+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:24.635 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:24.637+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:24.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:24.731+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:25.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:25.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:25.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:25.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:26.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:26.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:26.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:26.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:27.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:27.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:27.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:27.801+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:28.635 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:28.637+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:28.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:28.786+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:29.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:29.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:29.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:29.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:30.686 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:30.688+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:30.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:30.765+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:31.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:31.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:31.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:31.762+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:32.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:32.657+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:32.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:32.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:33.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:33.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:33.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:33.692+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:34.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:34.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:34.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:34.743+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:35.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:35.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:35.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:35.776+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:36.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:36.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:36.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:36.785+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:37.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:37.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:37.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:37.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:38.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:38.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:38.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:38.767+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:39.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:39.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:39.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:39.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:40.650 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:40.652+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:40.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:40.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:41.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:41.606+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:41.731 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:41.733+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:42.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:42.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:42.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:42.719+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:43.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:43.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:43.757 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:43.759+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:44.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:44.613+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:44.725 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:44.726+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:45.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:45.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:45.752 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:45.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:46.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:46.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:46.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:46.755+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:47.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:47.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:47.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:47.756+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:48.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:48.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:48.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:48.762+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:49.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:49.611+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:49.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:49.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:50.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:50.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:50.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:50.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:51.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:51.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:51.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:51.733+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:52.559 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:52.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:52.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:52.723+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:53.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:53.588+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:53.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:53.705+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:54.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:54.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:54.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:54.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:55.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:55.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:55.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:55.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:56.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:56.644+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:56.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:56.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:57.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:57.633+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:57.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:57.660+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:58.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:58.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:58.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:58.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:59.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:47:59.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:47:59.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:47:59.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:00.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:00.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:00.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:00.639+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:01.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:01.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:01.688 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:01.690+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:02.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:02.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:02.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:02.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:03.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:03.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:03.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:03.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:04.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:04.638+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:04.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:04.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:05.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:05.642+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:05.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:05.688+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:06.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:06.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:06.707 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:06.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:07.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:07.667+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:07.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:07.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:08.669 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:08.671+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:08.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:08.710+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:09.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:09.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:09.677 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:09.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:10.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:10.642+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:10.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:10.663+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:11.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:11.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:11.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:11.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:12.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:12.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:12.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:12.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:13.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:13.609+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:13.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:13.644+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:14.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:14.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:14.686 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:14.688+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:15.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:15.707+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:15.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:15.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:16.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:16.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:16.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:16.692+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:17.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:17.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:17.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:17.720+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:18.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:18.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:18.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:18.692+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:19.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:19.688+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:19.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:19.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:20.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:20.714+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:20.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:20.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:21.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:21.738+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:21.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:21.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:22.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:22.756+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:22.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:22.768+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:23.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:23.724+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:23.743 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:23.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:24.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:24.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:24.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:24.722+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:25.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:25.686+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:25.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:25.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:26.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:26.663+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:26.710 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:26.713+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:27.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:27.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:27.710 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:27.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:28.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:28.693+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:28.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:28.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:29.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:29.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:29.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:29.679+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:30.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:30.644+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:30.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:30.704+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:31.650 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:31.652+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:31.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:31.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:32.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:32.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:32.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:32.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:33.649 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:33.650+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:33.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:33.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:34.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:34.625+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:34.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:34.714+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:35.611 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:35.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:35.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:35.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:36.587 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:36.589+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:36.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:36.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:37.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:37.555+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:37.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:37.726+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:38.591 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:38.593+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:38.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:38.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:39.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:39.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:39.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:39.788+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:40.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:40.593+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:40.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:40.740+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:41.605 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:41.606+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:41.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:41.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:42.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:42.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:42.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:42.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:43.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:43.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:43.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:43.843+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:44.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:44.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:44.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:44.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:45.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:45.477+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:45.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:45.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:46.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:46.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:46.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:46.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:47.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:47.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:47.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:47.875+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:48.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:48.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:48.834 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:48.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:49.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:49.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:49.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:49.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:50.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:50.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:50.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:50.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:51.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:51.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:51.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:51.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:52.383 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:52.385+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:52.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:52.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:53.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:53.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:53.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:53.884+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:54.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:54.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:54.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:54.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:55.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:55.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:55.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:55.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:56.323 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:56.325+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:56.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:56.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:57.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:57.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:57.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:57.871+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:58.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:58.310+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:58.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:58.838+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:59.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:48:59.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:48:59.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:48:59.812+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:00.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:00.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:00.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:00.838+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:01.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:01.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:01.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:01.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:02.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:02.291+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:02.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:02.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:03.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:03.307+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:03.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:03.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:04.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:04.303+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:04.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:04.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:05.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:05.302+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:05.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:05.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:06.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:06.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:06.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:06.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:07.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:07.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:07.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:07.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:08.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:08.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:08.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:08.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:09.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:09.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:09.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:09.771+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:10.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:10.310+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:10.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:10.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:11.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:11.278+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:11.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:11.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:12.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:12.261+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:12.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:12.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:13.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:13.228+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:13.737 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:13.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:14.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:14.235+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:14.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:14.714+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:15.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:15.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:15.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:15.688+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:16.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:16.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:16.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:16.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:17.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:17.303+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:17.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:17.773+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:18.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:18.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:18.740 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:18.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:19.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:19.297+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:19.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:19.698+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:20.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:20.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:20.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:20.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:21.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:21.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:21.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:21.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:22.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:22.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:22.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:22.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:23.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:23.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:23.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:23.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:24.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:24.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:24.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:24.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:25.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:25.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:25.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:25.730+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:26.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:26.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:26.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:26.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:27.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:27.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:27.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:27.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:28.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:28.283+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:28.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:28.783+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:29.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:29.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:29.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:29.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:30.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:30.303+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:30.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:30.772+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:31.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:31.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:31.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:31.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:32.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:32.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:32.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:32.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:33.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:33.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:33.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:33.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:34.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:34.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:34.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:34.735+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:35.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:35.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:35.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:35.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:36.424 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:36.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:36.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:36.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:37.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:37.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:37.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:37.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:38.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:38.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:38.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:38.717+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:39.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:39.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:39.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:39.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:40.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:40.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:40.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:40.722+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:41.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:41.561+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:41.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:41.705+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:42.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:42.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:42.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:42.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:43.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:43.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:43.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:43.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:44.575 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:44.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:44.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:44.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:45.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:45.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:45.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:45.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:46.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:46.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:46.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:46.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:47.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:47.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:47.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:47.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:48.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:48.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:48.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:48.855+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:49.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:49.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:49.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:49.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:50.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:50.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:50.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:50.859+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:51.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:51.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:51.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:51.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:52.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:52.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:52.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:52.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:53.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:53.694+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:53.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:53.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:54.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:54.703+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:54.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:54.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:55.735 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:55.737+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:55.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:55.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:56.688 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:56.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:56.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:56.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:57.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:57.715+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:57.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:57.879+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:58.723 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:58.725+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:58.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:58.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:59.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:49:59.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:49:59.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:49:59.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:00.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:00.747+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:00.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:00.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:01.696 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:01.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:01.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:01.829+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:02.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:02.692+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:02.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:02.833+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:03.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:03.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:03.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:03.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:04.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:04.700+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:04.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:04.782+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:05.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:05.722+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:05.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:05.822+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:06.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:06.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:06.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:06.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:07.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:07.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:07.864 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:07.865+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:08.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:08.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:08.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:08.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:09.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:09.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:09.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:09.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:10.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:10.654+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:10.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:10.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:11.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:11.703+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:11.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:11.714+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:12.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:12.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:12.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:12.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:13.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:13.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:13.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:13.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:14.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:14.794+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:14.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:14.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:15.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:15.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:15.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:15.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:16.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:16.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:16.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:16.867+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:17.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:17.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:17.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:17.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:18.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:18.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:18.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:18.894+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:19.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:19.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:19.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:19.855+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:20.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:20.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:20.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:20.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:21.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:21.854+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:21.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:21.907+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:22.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:22.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:22.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:22.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:23.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:23.920+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:23.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:23.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:24.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:24.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:24.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:24.899+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:25.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:25.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:25.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:25.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:26.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:26.908+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:26.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:26.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:27.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:27.920+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:27.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:27.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:28.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:28.960+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:28.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:28.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:29.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:29.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:29.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:29.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:30.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:30.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:30.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:30.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:31.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:31.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:31.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:31.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:32.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:32.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:32.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:32.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:33.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:33.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:33.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:33.987+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:34.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:34.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:35.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:35.006+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:35.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:35.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:36.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:36.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:36.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:36.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:37.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:37.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:37.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:37.932+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:38.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:38.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:38.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:38.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:39.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:39.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:39.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:39.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:40.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:40.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:40.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:40.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:41.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:41.089+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:41.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:41.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:42.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:42.091+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:42.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:42.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:43.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:43.097+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:43.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:43.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:44.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:44.129+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:44.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:44.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:45.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:45.103+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:45.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:45.938+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:46.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:46.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:46.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:46.905+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:47.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:47.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:47.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:47.870+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:48.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:48.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:48.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:48.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:49.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:49.117+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:49.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:49.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:50.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:50.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:50.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:50.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:51.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:51.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:51.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:51.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:52.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:52.088+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:52.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:52.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:53.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:53.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:53.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:53.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:54.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:54.076+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:54.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:54.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:55.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:55.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:55.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:55.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:56.171 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:56.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:56.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:56.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:57.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:57.222+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:57.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:57.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:58.267 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:58.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:59.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:59.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:59.291 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:50:59.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:50:59.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:50:59.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:00.336 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:00.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:00.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:00.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:01.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:01.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:01.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:01.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:02.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:02.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:03.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:03.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:03.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:03.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:03.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:03.999+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:04.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:04.324+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:05.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:05.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:05.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:05.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:05.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:05.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:06.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:06.356+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:07.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:07.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:07.367 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:07.369+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:07.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:07.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:08.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:08.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:08.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:08.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:09.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:09.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:09.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:09.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:10.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:10.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:10.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:10.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:11.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:11.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:11.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:11.912+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:12.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:12.468+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:12.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:12.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:13.490 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:13.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:13.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:13.836+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:14.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:14.485+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:14.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:14.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:15.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:15.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:15.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:15.866+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:16.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:16.456+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:16.827 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:16.829+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:17.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:17.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:17.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:17.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:18.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:18.490+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:18.814 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:18.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:19.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:19.498+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:19.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:19.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:20.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:20.483+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:20.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:20.762+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:21.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:21.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:21.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:21.747+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:22.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:22.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:22.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:22.705+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:23.438 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:23.441+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:23.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:23.701+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:24.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:24.439+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:24.650 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:24.653+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:25.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:25.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:25.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:25.630+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:26.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:26.473+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:26.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:26.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:27.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:27.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:27.658 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:27.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:28.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:28.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:28.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:28.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:29.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:29.474+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:29.719 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:29.722+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:30.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:30.471+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:30.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:30.675+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:31.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:31.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:31.633 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:31.635+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:32.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:32.421+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:32.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:32.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:33.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:33.383+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:33.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:33.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:34.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:34.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:34.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:34.696+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:35.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:35.384+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:35.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:35.710+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:36.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:36.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:36.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:36.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:37.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:37.397+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:37.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:37.732+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:38.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:38.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:38.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:38.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:39.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:39.370+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:39.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:39.712+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:40.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:40.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:40.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:40.745+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:41.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:41.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:41.774 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:41.775+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:42.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:42.336+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:42.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:42.772+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:43.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:43.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:43.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:43.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:44.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:44.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:44.777 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:44.779+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:45.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:45.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:45.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:45.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:46.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:46.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:46.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:46.824+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:47.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:47.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:47.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:47.836+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:48.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:48.324+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:48.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:48.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:49.350 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:49.351+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:49.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:49.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:50.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:50.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:50.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:50.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:51.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:51.382+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:51.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:51.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:52.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:52.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:52.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:52.939+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:53.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:53.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:53.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:53.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:54.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:54.367+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:54.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:54.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:55.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:55.334+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:55.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:55.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:56.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:56.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:56.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:56.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:57.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:57.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:57.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:57.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:58.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:58.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:58.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:58.990+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:59.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:51:59.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:51:59.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:51:59.958+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:00.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:00.258+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:00.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:00.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:01.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:01.289+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:01.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:01.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:02.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:02.310+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:02.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:02.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:03.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:03.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:03.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:04.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:04.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:04.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:04.990 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:04.992+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:05.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:05.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:06.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:06.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:06.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:06.318+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:06.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:06.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:07.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:07.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:08.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:08.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:08.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:08.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:09.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:09.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:09.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:09.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:10.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:10.025+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:10.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:10.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:11.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:11.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:11.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:11.329+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:11.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:11.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:12.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:12.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:13.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:13.022+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:13.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:13.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:13.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:13.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:14.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:14.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:14.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:14.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:15.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:15.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:16.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:16.032+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:16.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:16.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:17.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:17.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:17.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:17.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:18.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:18.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:18.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:18.379+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:19.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:19.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:19.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:19.376+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:20.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:20.014+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:20.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:20.388+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:20.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:20.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:21.432 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:21.434+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:21.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:21.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:22.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:22.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:22.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:22.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:23.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:23.508+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:24.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:24.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:24.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:24.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:25.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:25.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:25.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:25.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:26.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:26.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:26.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:26.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:27.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:27.056+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:27.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:27.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:28.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:28.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:28.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:28.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:29.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:29.051+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:29.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:29.548+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:30.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:30.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:30.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:30.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:31.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:31.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:31.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:31.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:32.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:32.060+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:32.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:32.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:33.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:33.071+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:33.482 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:33.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:34.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:34.082+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:34.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:34.456+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:35.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:35.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:35.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:35.437+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:36.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:36.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:36.418 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:36.420+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:37.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:37.092+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:37.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:37.425+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:38.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:38.060+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:38.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:38.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:39.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:39.067+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:39.490 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:39.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:40.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:40.086+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:40.494 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:40.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:41.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:41.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:41.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:41.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:42.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:42.048+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:42.472 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:42.474+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:43.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:43.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:43.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:43.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:44.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:44.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:44.501 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:44.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:44.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:44.995+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:45.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:45.463+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:46.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:46.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:46.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:46.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:46.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:46.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:47.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:47.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:48.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:48.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:48.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:48.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:49.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:49.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:49.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:49.463+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:49.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:49.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:50.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:50.421+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:50.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:50.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:51.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:51.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:51.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:51.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:52.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:52.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:52.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:52.942+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:53.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:53.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:53.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:53.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:54.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:54.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:54.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:54.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:55.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:55.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:55.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:55.907+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:56.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:56.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:56.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:56.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:57.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:57.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:57.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:57.926+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:58.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:58.464+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:58.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:58.903+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:59.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:52:59.429+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:52:59.869 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:52:59.872+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:00.410 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:00.413+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:00.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:00.846+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:01.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:01.446+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:01.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:01.832+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:02.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:02.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:02.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:02.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:03.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:03.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:03.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:03.856+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:04.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:04.471+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:04.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:04.853+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:05.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:05.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:05.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:05.881+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:06.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:06.516+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:06.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:06.896+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:07.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:07.482+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:07.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:07.863+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:08.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:08.469+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:08.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:08.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:09.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:09.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:09.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:09.916+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:10.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:10.535+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:10.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:10.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:11.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:11.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:11.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:11.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:12.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:12.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:12.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:12.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:13.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:13.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:13.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:13.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:14.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:14.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:14.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:14.934+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:15.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:15.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:15.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:15.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:16.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:16.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:16.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:16.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:17.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:17.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:18.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:18.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:18.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:18.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:19.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:19.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:19.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:19.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:20.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:20.083+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:20.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:20.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:21.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:21.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:21.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:21.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:22.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:22.097+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:22.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:22.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:23.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:23.104+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:23.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:23.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:24.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:24.081+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:24.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:24.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:25.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:25.060+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:25.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:25.531+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:26.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:26.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:26.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:26.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:27.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:27.027+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:27.506 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:27.508+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:28.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:28.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:28.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:28.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:28.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:28.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:29.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:29.514+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:30.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:30.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:30.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:30.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:30.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:30.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:31.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:31.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:32.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:32.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:32.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:32.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:33.061 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:33.062+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:33.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:33.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:34.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:34.089+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:34.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:34.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:35.083 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:35.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:35.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:35.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:36.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:36.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:36.501 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:36.502+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:37.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:37.156+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:37.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:37.489+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:38.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:38.147+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:38.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:38.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:39.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:39.157+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:39.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:39.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:40.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:40.187+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:40.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:40.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:41.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:41.203+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:41.418 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:41.421+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:42.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:42.247+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:42.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:42.383+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:43.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:43.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:43.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:43.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:44.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:44.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:44.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:44.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:45.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:45.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:45.282 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:45.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:46.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:46.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:46.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:46.312+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:47.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:47.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:47.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:47.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:48.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:48.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:48.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:48.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:49.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:49.303+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:49.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:49.320+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:50.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:50.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:50.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:50.282+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:51.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:51.258+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:51.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:51.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:52.237 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:52.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:52.331 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:52.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:53.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:53.228+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:53.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:53.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:54.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:54.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:54.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:54.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:55.224 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:55.226+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:55.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:55.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:56.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:56.226+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:56.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:56.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:57.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:57.220+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:57.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:57.248+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:58.211 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:58.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:58.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:58.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:59.245 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:53:59.247+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:53:59.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:53:59.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:00.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:00.198+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:00.251 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:00.253+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:01.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:01.200+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:01.269 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:01.271+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:02.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:02.217+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:02.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:02.300+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:03.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:03.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:03.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:03.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:04.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:04.178+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:04.291 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:04.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:05.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:05.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:05.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:05.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:06.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:06.232+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:06.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:06.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:07.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:07.196+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:07.195 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:07.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:08.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:08.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:08.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:08.241+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:09.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:09.249+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:09.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:09.280+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:10.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:10.222+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:10.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:10.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:11.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:11.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:11.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:11.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:12.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:12.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:12.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:12.340+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:13.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:13.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:13.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:13.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:14.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:14.173+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:14.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:14.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:15.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:15.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:15.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:15.285+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:16.195 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:16.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:16.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:16.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:17.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:17.196+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:17.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:17.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:18.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:18.157+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:18.260 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:18.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:19.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:19.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:19.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:19.250+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:20.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:20.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:20.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:20.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:21.136 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:21.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:21.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:21.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:22.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:22.134+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:22.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:22.290+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:23.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:23.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:23.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:23.287+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:24.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:24.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:24.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:24.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:25.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:25.121+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:25.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:25.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:26.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:26.098+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:26.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:26.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:27.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:27.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:27.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:27.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:28.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:28.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:28.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:28.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:29.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:29.106+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:29.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:29.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:30.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:30.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:30.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:30.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:31.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:31.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:31.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:31.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:32.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:32.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:32.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:32.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:33.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:33.157+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:33.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:33.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:34.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:34.145+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:34.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:34.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:35.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:35.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:35.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:35.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:36.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:36.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:36.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:36.288+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:37.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:37.101+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:37.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:37.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:38.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:38.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:38.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:38.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:39.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:39.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:39.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:39.278+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:40.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:40.175+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:40.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:40.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:41.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:41.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:41.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:41.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:42.187 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:42.188+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:42.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:42.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:43.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:43.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:43.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:43.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:44.211 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:44.213+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:44.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:44.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:45.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:45.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:45.305 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:45.307+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:46.212 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:46.214+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:46.337 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:46.338+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:47.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:47.228+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:47.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:47.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:48.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:48.218+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:48.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:48.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:49.211 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:49.213+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:49.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:49.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:50.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:50.227+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:50.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:50.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:51.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:51.216+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:51.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:51.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:52.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:52.241+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:52.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:52.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:53.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:53.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:53.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:53.338+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:54.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:54.266+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:54.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:54.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:55.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:55.289+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:55.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:55.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:56.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:56.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:56.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:56.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:57.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:57.288+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:57.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:57.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:58.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:58.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:58.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:58.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:59.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:54:59.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:54:59.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:54:59.361+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:00.291 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:00.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:00.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:00.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:01.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:01.287+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:01.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:01.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:02.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:02.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:02.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:02.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:03.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:03.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:03.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:03.331+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:04.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:04.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:04.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:04.356+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:05.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:05.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:05.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:05.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:06.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:06.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:06.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:06.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:07.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:07.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:07.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:07.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:08.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:08.385+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:08.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:08.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:09.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:09.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:09.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:09.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:10.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:10.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:10.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:10.448+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:11.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:11.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:11.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:11.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:12.373 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:12.375+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:12.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:12.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:13.418 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:13.421+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:13.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:13.470+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:14.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:14.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:14.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:14.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:15.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:15.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:15.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:15.487+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:16.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:16.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:16.460 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:16.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:17.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:17.299+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:17.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:17.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:18.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:18.329+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:18.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:18.448+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:19.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:19.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:19.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:19.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:20.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:20.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:20.449 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:20.451+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:21.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:21.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:21.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:21.452+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:22.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:22.365+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:22.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:22.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:23.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:23.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:23.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:23.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:24.362 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:24.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:24.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:24.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:25.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:25.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:25.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:25.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:26.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:26.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:26.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:26.378+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:27.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:27.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:27.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:27.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:28.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:28.298+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:28.344 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:28.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:29.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:29.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:29.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:29.316+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:30.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:30.334+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:30.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:30.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:31.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:31.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:31.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:31.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:32.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:32.259+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:32.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:32.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:33.251 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:33.252+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:33.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:33.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:34.254 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:34.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:34.378 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:34.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:35.228 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:35.229+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:35.378 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:35.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:36.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:36.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:36.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:36.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:37.198 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:37.200+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:37.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:37.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:38.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:38.217+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:38.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:38.387+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:39.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:39.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:39.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:39.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:40.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:40.217+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:40.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:40.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:41.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:41.258+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:41.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:41.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:42.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:42.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:42.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:42.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:43.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:43.220+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:43.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:43.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:44.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:44.249+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:44.302 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:44.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:45.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:45.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:45.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:45.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:46.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:46.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:46.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:46.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:47.230 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:47.232+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:47.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:47.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:48.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:48.265+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:48.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:48.394+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:49.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:49.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:49.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:49.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:50.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:50.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:50.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:50.361+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:51.282 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:51.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:51.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:51.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:52.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:52.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:52.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:52.322+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:53.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:53.312+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:53.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:53.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:54.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:54.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:54.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:54.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:55.309 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:55.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:55.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:55.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:56.291 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:56.293+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:56.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:56.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:57.270 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:57.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:57.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:57.273+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:58.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:58.292+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:58.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:58.300+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:59.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:55:59.262+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:55:59.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:55:59.338+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:00.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:00.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:00.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:00.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:01.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:01.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:01.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:01.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:02.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:02.298+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:02.337 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:02.340+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:03.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:03.335+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:03.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:03.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:04.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:04.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:04.375 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:04.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:05.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:05.412+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:05.414 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:05.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:06.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:06.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:06.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:06.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:07.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:07.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:07.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:07.482+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:08.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:08.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:08.503 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:08.505+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:09.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:09.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:09.479 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:09.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:10.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:10.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:10.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:10.469+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:11.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:11.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:11.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:11.486+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:12.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:12.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:12.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:12.485+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:13.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:13.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:13.472 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:13.474+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:14.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:14.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:14.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:14.469+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:15.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:15.257+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:15.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:15.452+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:16.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:16.280+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:16.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:16.455+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:17.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:17.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:17.501 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:17.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:18.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:18.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:18.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:18.467+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:19.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:19.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:19.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:19.506+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:20.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:20.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:20.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:20.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:21.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:21.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:21.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:21.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:22.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:22.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:22.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:22.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:23.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:23.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:23.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:23.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:24.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:24.362+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:24.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:24.514+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:25.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:25.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:25.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:25.483+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:26.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:26.351+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:26.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:26.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:27.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:27.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:27.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:27.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:28.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:28.321+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:28.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:28.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:29.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:29.314+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:29.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:29.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:30.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:30.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:30.485 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:30.487+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:31.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:31.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:31.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:31.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:32.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:32.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:32.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:32.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:33.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:33.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:33.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:33.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:34.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:34.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:34.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:34.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:35.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:35.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:35.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:35.460+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:36.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:36.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:36.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:36.439+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:37.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:37.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:37.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:37.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:38.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:38.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:38.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:38.491+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:39.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:39.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:39.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:39.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:40.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:40.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:40.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:40.515+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:41.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:41.394+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:41.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:41.473+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:42.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:42.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:42.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:42.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:43.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:43.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:43.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:43.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:44.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:44.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:44.503 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:44.506+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:45.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:45.292+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:45.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:45.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:46.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:46.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:46.559 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:46.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:47.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:47.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:47.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:47.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:48.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:48.337+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:48.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:48.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:49.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:49.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:49.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:49.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:50.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:50.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:50.649 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:50.651+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:51.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:51.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:51.699 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:51.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:52.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:52.362+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:52.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:52.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:53.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:53.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:53.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:53.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:54.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:54.388+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:54.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:54.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:55.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:55.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:55.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:55.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:56.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:56.401+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:56.787 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:56.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:57.363 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:57.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:57.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:57.790+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:58.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:58.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:58.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:58.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:59.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:56:59.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:56:59.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:56:59.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:00.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:00.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:00.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:00.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:01.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:01.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:01.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:01.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:02.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:02.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:02.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:02.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:03.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:03.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:03.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:03.724+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:04.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:04.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:04.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:04.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:05.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:05.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:05.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:05.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:06.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:06.345+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:06.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:06.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:07.302 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:07.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:07.834 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:07.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:08.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:08.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:08.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:08.842+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:09.286 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:09.288+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:09.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:09.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:10.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:10.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:10.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:10.790+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:11.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:11.240+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:11.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:11.819+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:12.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:12.264+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:12.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:12.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:13.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:13.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:13.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:13.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:14.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:14.218+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:14.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:14.842+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:15.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:15.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:15.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:15.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:16.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:16.243+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:16.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:16.855+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:17.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:17.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:17.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:17.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:18.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:18.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:18.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:18.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:19.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:19.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:19.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:19.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:20.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:20.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:20.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:20.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:21.302 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:21.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:21.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:21.776+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:22.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:22.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:22.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:22.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:23.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:23.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:23.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:23.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:24.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:24.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:24.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:24.767+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:25.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:25.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:25.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:25.796+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:26.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:26.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:26.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:26.767+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:27.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:27.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:27.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:27.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:28.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:28.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:28.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:28.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:29.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:29.240+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:29.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:29.726+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:30.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:30.240+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:30.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:30.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:31.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:31.247+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:31.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:31.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:32.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:32.200+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:32.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:32.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:33.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:33.222+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:33.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:33.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:34.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:34.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:34.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:34.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:35.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:35.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:35.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:35.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:36.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:36.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:36.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:36.726+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:37.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:37.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:37.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:37.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:38.314 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:38.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:38.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:38.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:39.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:39.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:39.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:39.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:40.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:40.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:40.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:40.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:41.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:41.342+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:41.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:41.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:42.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:42.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:42.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:42.805+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:43.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:43.351+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:43.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:43.807+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:44.398 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:44.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:44.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:44.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:45.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:45.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:45.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:45.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:46.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:46.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:46.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:46.875+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:47.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:47.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:47.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:47.908+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:48.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:48.421+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:48.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:48.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:49.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:49.401+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:49.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:49.937+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:50.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:50.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:50.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:50.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:51.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:51.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:51.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:51.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:52.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:52.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:52.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:52.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:53.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:53.443+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:53.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:53.992+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:54.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:54.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:54.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:54.986+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:55.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:55.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:55.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:55.971+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:56.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:56.554+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:56.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:56.974+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:57.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:57.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:58.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:58.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:58.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:58.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:59.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:57:59.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:57:59.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:57:59.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:00.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:00.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:00.477 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:00.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:00.959 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:00.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:01.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:01.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:01.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:01.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:02.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:02.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:02.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:02.904+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:03.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:03.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:03.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:03.947+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:04.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:04.565+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:04.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:04.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:05.528 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:05.530+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:05.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:05.975+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:06.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:06.525+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:06.987 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:06.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:07.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:07.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:07.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:08.001+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:08.605 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:08.607+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:08.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:08.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:09.633 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:09.635+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:09.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:09.928+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:10.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:10.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:10.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:10.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:11.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:11.624+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:11.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:11.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:12.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:12.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:12.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:12.979+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:13.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:13.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:14.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:14.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:14.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:14.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:15.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:15.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:15.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:15.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:16.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:16.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:16.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:16.696+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:17.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:17.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:17.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:17.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:17.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:17.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:18.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:18.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:19.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:19.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:19.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:19.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:19.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:19.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:20.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:20.574+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:20.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:20.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:21.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:21.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:21.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:21.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:22.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:22.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:22.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:22.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:23.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:23.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:23.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:23.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:24.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:24.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:24.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:24.915+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:25.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:25.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:25.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:25.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:26.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:26.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:26.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:26.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:27.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:27.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:27.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:27.849+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:28.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:28.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:28.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:28.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:29.645 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:29.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:29.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:29.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:30.654 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:30.656+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:30.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:30.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:31.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:31.633+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:31.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:31.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:32.654 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:32.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:32.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:32.835+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:33.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:33.640+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:33.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:33.827+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:34.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:34.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:34.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:34.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:35.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:35.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:35.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:35.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:36.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:36.712+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:36.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:36.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:37.697 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:37.699+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:37.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:37.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:38.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:38.681+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:38.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:38.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:39.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:39.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:39.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:39.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:40.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:40.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:40.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:40.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:41.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:41.705+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:41.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:41.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:42.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:42.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:42.834 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:42.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:43.769 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:43.771+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:43.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:43.859+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:44.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:44.820+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:44.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:44.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:45.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:45.792+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:45.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:45.871+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:46.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:46.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:46.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:46.884+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:47.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:47.857+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:47.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:47.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:48.876 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:48.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:48.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:48.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:49.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:49.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:49.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:49.885+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:50.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:50.862+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:50.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:50.873+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:51.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:51.879+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:51.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:51.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:52.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:52.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:52.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:52.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:53.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:53.890+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:53.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:53.898+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:54.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:54.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:54.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:54.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:55.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:55.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:55.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:55.932+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:56.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:56.871+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:56.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:56.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:57.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:57.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:57.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:57.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:58.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:58.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:58.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:58.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:59.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:58:59.874+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:58:59.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:58:59.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:00.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:00.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:00.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:00.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:01.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:01.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:01.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:01.940+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:02.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:02.881+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:02.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:02.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:03.842 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:03.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:03.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:03.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:04.846 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:04.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:04.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:04.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:05.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:05.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:05.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:05.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:06.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:06.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:06.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:06.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:07.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:07.866+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:07.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:07.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:08.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:08.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:08.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:08.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:09.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:09.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:09.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:09.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:10.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:10.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:10.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:10.953+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:11.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:11.926+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:11.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:11.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:12.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:12.925+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:12.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:12.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:13.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:13.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:13.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:13.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:14.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:14.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:14.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:14.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:15.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:15.900+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:15.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:15.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:16.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:16.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:16.902 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:16.904+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:17.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:17.892+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:17.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:17.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:18.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:18.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:18.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:18.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:19.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:19.868+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:19.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:19.990+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:20.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:20.889+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:20.983 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:20.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:21.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:21.867+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:21.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:21.971+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:22.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:22.890+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:22.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:22.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:23.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:23.895+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:23.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:23.937+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:24.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:24.885+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:24.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:24.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:25.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:25.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:25.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:25.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:26.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:26.841+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:26.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:26.899+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:27.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:27.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:27.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:27.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:28.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:28.822+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:28.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:28.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:29.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:29.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:29.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:29.888+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:30.894 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:30.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:30.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:30.928+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:31.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:31.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:31.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:31.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:32.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:32.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:32.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:32.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:33.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:33.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:33.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:33.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:34.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:34.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:34.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:34.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:35.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:35.818+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:35.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:35.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:36.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:36.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:36.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:36.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:37.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:37.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:37.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:37.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:38.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:38.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:38.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:38.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:39.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:39.842+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:39.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:39.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:40.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:40.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:40.939 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:40.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:41.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:41.819+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:41.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:41.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:42.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:42.859+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:42.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:42.907+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:43.834 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:43.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:43.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:43.859+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:44.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:44.840+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:44.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:44.863+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:45.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:45.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:45.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:45.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:46.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:46.856+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:46.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:46.895+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:47.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:47.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:47.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:47.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:48.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:48.785+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:48.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:48.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:49.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:49.759+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:49.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:49.934+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:50.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:50.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:50.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:50.939+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:51.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:51.759+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:51.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:51.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:52.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:52.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:52.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:52.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:53.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:53.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:53.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:53.885+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:54.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:54.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:54.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:54.919+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:55.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:55.670+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:55.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:55.881+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:56.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:56.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:56.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:56.846+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:57.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:57.730+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:57.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:57.896+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:58.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:58.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:58.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:58.902+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:59.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T14:59:59.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T14:59:59.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T14:59:59.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:00.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:00.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:00.908 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:00.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:01.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:01.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:01.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:01.879+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:02.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:02.776+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:02.830 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:02.831+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:03.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:03.730+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:03.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:03.859+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:04.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:04.743+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:04.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:04.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:05.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:05.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:05.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:05.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:06.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:06.650+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:06.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:06.774+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:07.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:07.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:07.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:07.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:08.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:08.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:08.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:08.805+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:09.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:09.611+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:09.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:09.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:10.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:10.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:10.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:10.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:11.631 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:11.633+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:11.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:11.847+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:12.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:12.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:12.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:12.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:13.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:13.668+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:13.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:13.831+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:14.639 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:14.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:14.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:14.858+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:15.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:15.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:15.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:15.868+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:16.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:16.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:16.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:16.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:17.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:17.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:17.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:17.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:18.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:18.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:18.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:18.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:19.710 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:19.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:19.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:19.831+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:20.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:20.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:20.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:20.789+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:21.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:21.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:21.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:21.822+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:22.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:22.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:22.846 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:22.848+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:23.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:23.768+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:23.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:23.819+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:24.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:24.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:24.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:24.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:25.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:25.771+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:25.840 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:25.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:26.768 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:26.770+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:26.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:26.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:27.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:27.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:27.861 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:27.862+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:28.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:28.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:28.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:28.903+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:29.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:29.659+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:29.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:29.935+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:30.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:30.707+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:30.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:30.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:31.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:31.710+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:31.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:31.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:32.682 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:32.685+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:32.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:32.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:33.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:33.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:33.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:33.893+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:34.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:34.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:34.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:34.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:35.661 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:35.664+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:35.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:35.902+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:36.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:36.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:36.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:36.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:37.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:37.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:37.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:37.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:38.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:38.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:38.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:38.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:39.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:39.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:39.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:39.990+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:40.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:40.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:40.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:40.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:41.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:41.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:41.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:41.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:42.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:42.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:42.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:42.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:43.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:43.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:43.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:43.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:44.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:44.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:44.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:44.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:45.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:45.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:45.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:45.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:46.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:46.785+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:46.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:46.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:47.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:47.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:48.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:48.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:48.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:48.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:49.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:49.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:49.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:49.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:49.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:49.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:50.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:50.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:51.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:51.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:51.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:51.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:52.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:52.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:52.649 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:52.651+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:53.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:53.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:53.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:53.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:54.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:54.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:54.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:54.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:55.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:55.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:55.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:55.743+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:56.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:56.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:56.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:56.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:57.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:57.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:57.745 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:57.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:58.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:58.080+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:58.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:58.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:59.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:00:59.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:00:59.653 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:00:59.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:00.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:00.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:00.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:00.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:01.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:01.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:01.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:01.668+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:02.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:02.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:02.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:02.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:02.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:03.001+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:03.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:03.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:03.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:03.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:04.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:04.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:04.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:04.972+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:05.644 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:05.646+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:05.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:05.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:06.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:06.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:06.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:06.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:07.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:07.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:08.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:08.031+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:08.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:08.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:09.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:09.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:09.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:09.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:10.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:10.088+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:10.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:10.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:11.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:11.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:11.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:11.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:12.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:12.121+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:12.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:12.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:13.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:13.115+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:13.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:13.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:14.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:14.152+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:14.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:14.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:15.116 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:15.117+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:15.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:15.664+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:16.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:16.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:16.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:16.687+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:17.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:17.089+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:17.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:17.650+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:18.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:18.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:18.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:18.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:19.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:19.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:19.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:19.622+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:19.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:19.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:20.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:20.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:21.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:21.048+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:21.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:21.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:22.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:22.096+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:22.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:22.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:23.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:23.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:23.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:23.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:24.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:24.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:24.659 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:24.662+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:25.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:25.108+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:25.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:25.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:26.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:26.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:26.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:26.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:27.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:27.171+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:27.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:27.645+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:28.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:28.125+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:28.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:28.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:29.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:29.135+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:29.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:29.639+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:30.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:30.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:30.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:30.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:31.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:31.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:31.636 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:31.638+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:32.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:32.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:32.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:32.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:33.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:33.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:33.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:33.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:34.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:34.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:34.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:34.606+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:35.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:35.081+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:35.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:35.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:36.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:36.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:36.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:36.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:37.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:37.083+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:37.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:37.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:38.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:38.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:38.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:38.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:39.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:39.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:39.616 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:39.618+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:40.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:40.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:40.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:40.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:41.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:41.052+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:41.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:41.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:42.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:42.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:42.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:42.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:43.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:43.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:43.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:43.491+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:43.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:43.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:44.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:44.470+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:45.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:45.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:45.475 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:45.476+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:45.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:45.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:46.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:46.515+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:47.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:47.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:47.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:47.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:47.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:47.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:48.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:48.536+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:48.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:48.995+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:49.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:49.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:50.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:50.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:50.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:50.540+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:51.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:51.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:51.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:51.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:52.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:52.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:52.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:52.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:53.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:53.075+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:53.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:53.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:54.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:54.081+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:54.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:54.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:55.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:55.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:55.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:55.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:56.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:56.074+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:56.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:56.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:57.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:57.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:57.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:57.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:58.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:58.113+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:58.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:58.531+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:59.158 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:01:59.160+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:01:59.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:01:59.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:00.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:00.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:00.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:00.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:01.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:01.158+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:01.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:01.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:02.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:02.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:02.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:02.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:03.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:03.169+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:03.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:03.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:04.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:04.196+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:04.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:04.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:05.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:05.235+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:05.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:05.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:06.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:06.243+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:06.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:06.630+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:07.210 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:07.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:07.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:07.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:08.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:08.260+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:08.639 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:08.642+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:09.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:09.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:09.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:09.646+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:10.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:10.271+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:10.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:10.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:11.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:11.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:11.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:11.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:12.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:12.235+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:12.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:12.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:13.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:13.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:13.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:13.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:14.243 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:14.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:14.740 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:14.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:15.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:15.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:15.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:15.785+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:16.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:16.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:16.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:16.787+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:17.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:17.221+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:17.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:17.740+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:18.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:18.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:18.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:18.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:19.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:19.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:19.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:19.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:20.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:20.180+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:20.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:20.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:21.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:21.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:21.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:21.694+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:22.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:22.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:22.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:22.658+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:23.136 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:23.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:23.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:23.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:24.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:24.156+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:24.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:24.584+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:25.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:25.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:25.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:25.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:26.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:26.147+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:26.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:26.515+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:27.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:27.106+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:27.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:27.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:28.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:28.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:28.482 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:28.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:29.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:29.055+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:29.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:29.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:30.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:30.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:30.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:30.489+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:30.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:30.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:31.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:31.464+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:31.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:31.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:32.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:32.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:32.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:32.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:33.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:33.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:33.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:33.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:34.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:34.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:34.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:34.938+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:35.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:35.535+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:35.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:35.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:36.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:36.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:36.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:36.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:37.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:37.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:37.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:37.917+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:38.490 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:38.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:38.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:38.938+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:39.500 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:39.502+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:39.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:39.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:40.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:40.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:40.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:40.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:41.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:41.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:41.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:41.905+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:42.537 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:42.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:42.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:42.866+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:43.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:43.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:43.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:43.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:44.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:44.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:44.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:44.889+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:45.544 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:45.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:45.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:45.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:46.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:46.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:46.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:46.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:47.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:47.517+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:48.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:48.003+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:48.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:48.500+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:49.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:49.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:49.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:49.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:50.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:50.075+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:50.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:50.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:51.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:51.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:51.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:51.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:52.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:52.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:52.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:52.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:53.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:53.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:53.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:53.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:54.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:54.052+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:54.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:54.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:55.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:55.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:55.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:55.659+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:55.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:55.972+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:56.639 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:56.642+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:57.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:57.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:57.649 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:57.651+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:58.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:58.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:58.692 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:58.694+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:59.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:02:59.088+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:02:59.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:02:59.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:00.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:00.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:00.646 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:00.648+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:01.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:01.069+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:01.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:01.645+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:02.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:02.080+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:02.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:02.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:03.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:03.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:03.659 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:03.661+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:04.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:04.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:04.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:04.710+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:05.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:05.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:05.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:05.705+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:06.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:06.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:06.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:06.657+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:07.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:07.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:07.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:07.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:08.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:08.059+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:08.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:08.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:09.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:09.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:09.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:09.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:10.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:10.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:10.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:10.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:11.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:11.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:11.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:11.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:12.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:12.027+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:12.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:12.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:13.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:13.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:13.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:13.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:14.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:14.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:14.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:14.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:14.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:14.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:15.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:15.773+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:15.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:15.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:16.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:16.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:17.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:17.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:17.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:17.812+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:18.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:18.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:18.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:18.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:19.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:19.046+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:19.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:19.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:20.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:20.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:20.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:20.687+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:21.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:21.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:21.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:21.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:21.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:22.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:22.650 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:22.652+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:22.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:22.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:23.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:23.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:24.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:24.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:24.667 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:24.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:25.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:25.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:25.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:25.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:26.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:26.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:26.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:26.696+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:27.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:27.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:27.661 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:27.662+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:28.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:28.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:28.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:28.710+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:29.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:29.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:29.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:29.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:30.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:30.055+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:30.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:30.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:31.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:31.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:31.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:31.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:32.061 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:32.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:32.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:32.644+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:33.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:33.111+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:33.645 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:33.647+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:34.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:34.104+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:34.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:34.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:35.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:35.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:35.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:35.730+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:36.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:36.101+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:36.725 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:36.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:37.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:37.143+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:37.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:37.745+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:38.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:38.095+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:38.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:38.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:39.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:39.113+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:39.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:39.733+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:40.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:40.093+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:40.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:40.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:41.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:41.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:41.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:41.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:42.048 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:42.051+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:42.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:42.782+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:43.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:43.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:43.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:43.772+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:44.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:44.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:44.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:44.762+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:45.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:45.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:45.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:45.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:46.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:46.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:46.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:46.831+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:47.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:47.019+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:47.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:47.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:48.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:48.005+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:48.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:48.846+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:49.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:49.019+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:49.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:49.894+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:50.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:50.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:50.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:50.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:51.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:51.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:51.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:51.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:52.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:52.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:52.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:52.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:53.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:53.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:53.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:53.899+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:54.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:54.052+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:54.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:54.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:55.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:55.074+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:55.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:55.914+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:56.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:56.062+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:56.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:56.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:57.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:57.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:57.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:57.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:58.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:58.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:58.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:58.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:59.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:59.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:59.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:03:59.972+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:03:59.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:03:59.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:01.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:01.005+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:01.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:01.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:01.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:01.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:02.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:02.023+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:02.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:02.937+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:03.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:03.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:03.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:03.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:04.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:04.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:04.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:04.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:05.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:05.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:05.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:05.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:06.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:06.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:06.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:06.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:07.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:07.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:07.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:07.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:08.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:08.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:08.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:08.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:09.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:09.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:09.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:09.938+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:10.136 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:10.137+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:10.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:10.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:11.144 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:11.145+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:11.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:11.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:12.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:12.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:12.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:12.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:13.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:13.122+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:13.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:13.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:14.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:14.136+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:14.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:14.928+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:15.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:15.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:15.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:15.916+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:16.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:16.130+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:16.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:16.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:17.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:17.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:17.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:17.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:18.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:18.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:18.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:18.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:19.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:19.169+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:19.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:19.919+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:20.169 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:20.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:20.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:20.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:21.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:21.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:21.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:21.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:22.201 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:22.204+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:22.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:22.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:23.251 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:23.254+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:23.990 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:23.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:24.208 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:24.211+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:24.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:24.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:25.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:25.186+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:25.990 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:25.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:26.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:26.148+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:27.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:27.028+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:27.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:27.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:28.061 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:28.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:28.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:28.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:29.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:29.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:29.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:29.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:30.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:30.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:30.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:30.164+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:31.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:31.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:31.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:31.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:32.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:32.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:32.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:32.206+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:33.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:33.165+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:33.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:33.185+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:34.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:34.142+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:34.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:34.206+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:35.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:35.150+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:35.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:35.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:36.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:36.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:36.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:36.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:37.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:37.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:37.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:37.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:38.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:38.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:38.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:38.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:39.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:39.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:39.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:39.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:40.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:40.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:40.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:40.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:41.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:41.236+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:41.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:41.313+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:42.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:42.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:42.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:42.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:43.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:43.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:43.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:43.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:44.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:44.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:44.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:44.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:45.345 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:45.347+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:45.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:45.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:46.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:46.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:46.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:46.379+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:47.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:47.397+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:47.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:47.419+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:48.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:48.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:48.389 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:48.391+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:49.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:49.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:49.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:49.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:50.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:50.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:50.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:50.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:51.377 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:51.379+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:51.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:51.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:52.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:52.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:52.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:52.421+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:53.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:53.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:53.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:53.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:54.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:54.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:54.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:54.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:55.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:55.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:55.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:55.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:56.389 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:56.391+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:56.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:56.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:57.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:57.363+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:57.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:57.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:58.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:58.316+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:58.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:58.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:59.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:04:59.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:04:59.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:04:59.505+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:00.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:00.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:00.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:00.529+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:01.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:01.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:01.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:01.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:02.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:02.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:02.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:02.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:03.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:03.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:03.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:03.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:04.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:04.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:04.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:04.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:05.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:05.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:05.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:05.599+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:06.367 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:06.368+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:06.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:06.561+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:07.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:07.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:07.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:07.604+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:08.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:08.316+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:08.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:08.647+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:09.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:09.318+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:09.625 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:09.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:10.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:10.336+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:10.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:10.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:11.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:11.375+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:11.625 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:11.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:12.389 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:12.392+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:12.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:12.612+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:13.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:13.429+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:13.575 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:13.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:14.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:14.452+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:14.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:14.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:15.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:15.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:15.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:15.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:16.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:16.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:16.696 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:16.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:17.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:17.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:17.731 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:17.733+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:18.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:18.439+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:18.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:18.748+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:19.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:19.425+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:19.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:19.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:20.404 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:20.406+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:20.688 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:20.690+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:21.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:21.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:21.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:21.659+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:22.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:22.442+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:22.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:22.685+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:23.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:23.405+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:23.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:23.689+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:24.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:24.413+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:24.662 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:24.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:25.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:25.435+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:25.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:25.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:26.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:26.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:26.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:26.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:27.472 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:27.474+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:27.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:27.707+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:28.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:28.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:28.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:28.712+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:29.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:29.460+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:29.733 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:29.735+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:30.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:30.467+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:30.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:30.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:31.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:31.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:31.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:31.748+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:32.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:32.456+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:32.769 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:32.771+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:33.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:33.491+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:33.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:33.765+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:34.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:34.470+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:34.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:34.781+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:35.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:35.427+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:35.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:35.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:36.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:36.460+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:36.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:36.705+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:37.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:37.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:37.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:37.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:38.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:38.435+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:38.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:38.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:39.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:39.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:39.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:39.695+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:40.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:40.476+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:40.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:40.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:41.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:41.471+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:41.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:41.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:42.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:42.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:42.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:42.710+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:43.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:43.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:43.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:43.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:44.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:44.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:44.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:44.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:45.447 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:45.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:45.688 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:45.689+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:46.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:46.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:46.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:46.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:47.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:47.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:47.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:47.637+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:48.362 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:48.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:48.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:48.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:49.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:49.390+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:49.649 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:49.650+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:50.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:50.426+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:50.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:50.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:51.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:51.444+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:51.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:51.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:52.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:52.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:52.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:52.626+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:53.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:53.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:53.654 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:53.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:54.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:54.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:54.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:54.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:55.501 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:55.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:55.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:55.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:56.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:56.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:56.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:56.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:57.515 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:57.518+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:57.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:57.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:58.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:58.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:58.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:58.753+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:59.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:05:59.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:05:59.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:05:59.730+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:00.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:00.592+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:00.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:00.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:01.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:01.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:01.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:01.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:02.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:02.609+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:02.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:02.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:03.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:03.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:03.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:03.739+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:04.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:04.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:04.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:04.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:05.674 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:05.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:05.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:05.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:06.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:06.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:06.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:06.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:07.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:07.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:07.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:07.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:08.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:08.667+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:08.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:08.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:09.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:09.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:09.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:09.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:10.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:10.730+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:10.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:10.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:11.707 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:11.709+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:11.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:11.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:12.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:12.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:12.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:12.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:13.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:13.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:13.787 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:13.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:14.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:14.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:14.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:14.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:15.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:15.707+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:15.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:15.817+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:16.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:16.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:16.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:16.835+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:17.623 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:17.624+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:17.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:17.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:18.614 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:18.616+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:18.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:18.801+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:19.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:19.648+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:19.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:19.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:20.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:20.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:20.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:20.833+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:21.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:21.712+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:21.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:21.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:22.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:22.678+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:22.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:22.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:23.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:23.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:23.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:23.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:24.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:24.637+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:24.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:24.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:25.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:25.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:25.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:25.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:26.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:26.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:26.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:26.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:27.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:27.688+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:27.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:27.804+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:28.678 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:28.680+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:28.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:28.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:29.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:29.649+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:29.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:29.765+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:30.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:30.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:30.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:30.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:31.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:31.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:31.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:31.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:32.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:32.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:32.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:32.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:33.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:33.670+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:33.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:33.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:34.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:34.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:34.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:34.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:35.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:35.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:35.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:35.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:36.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:36.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:36.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:36.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:37.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:37.648+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:37.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:37.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:38.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:38.688+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:38.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:38.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:39.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:39.666+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:39.771 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:39.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:40.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:40.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:40.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:40.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:41.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:41.641+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:41.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:41.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:42.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:42.685+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:42.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:42.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:43.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:43.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:43.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:43.842+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:44.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:44.688+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:44.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:44.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:45.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:45.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:45.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:45.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:46.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:46.717+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:46.926 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:46.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:47.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:47.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:47.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:47.937+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:48.716 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:48.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:48.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:48.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:49.711 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:49.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:49.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:49.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:50.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:50.678+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:50.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:50.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:51.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:51.665+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:51.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:51.893+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:52.651 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:52.653+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:52.940 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:52.942+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:53.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:53.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:53.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:53.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:54.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:54.609+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:54.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:54.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:55.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:55.654+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:55.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:55.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:56.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:56.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:56.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:57.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:57.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:57.705+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:57.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:57.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:58.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:58.716+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:59.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:59.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:59.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:06:59.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:06:59.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:06:59.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:00.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:00.725+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:00.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:00.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:01.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:01.736+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:01.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:01.877+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:02.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:02.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:02.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:02.841+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:03.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:03.803+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:03.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:03.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:04.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:04.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:04.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:04.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:05.831 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:05.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:05.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:05.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:06.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:06.796+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:06.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:06.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:07.757 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:07.759+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:08.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:08.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:08.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:08.795+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:09.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:09.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:09.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:09.840+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:09.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:09.992+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:10.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:10.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:10.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:10.953+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:11.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:11.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:11.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:11.986+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:12.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:12.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:12.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:12.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:13.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:13.889+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:14.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:14.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:14.876 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:14.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:14.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:14.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:15.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:15.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:15.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:15.953+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:16.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:16.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:16.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:17.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:17.876 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:17.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:17.959 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:17.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:18.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:18.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:18.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:18.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:19.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:19.890+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:19.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:19.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:20.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:20.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:20.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:20.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:21.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:21.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:21.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:21.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:22.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:22.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:23.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:23.023+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:23.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:23.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:24.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:24.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:24.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:24.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:24.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:24.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:25.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:25.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:25.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:25.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:26.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:26.919+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:26.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:26.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:27.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:27.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:27.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:27.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:28.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:28.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:28.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:28.942+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:29.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:29.883+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:29.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:29.935+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:30.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:30.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:30.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:30.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:31.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:31.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:31.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:31.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:32.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:32.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:32.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:32.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:33.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:33.927+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:33.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:33.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:34.924 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:34.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:35.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:35.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:35.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:35.947+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:36.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:36.028+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:36.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:36.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:37.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:37.005+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:37.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:37.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:37.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:37.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:38.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:38.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:38.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:38.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:39.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:39.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:39.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:39.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:40.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:40.975+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:40.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:40.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:41.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:41.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:42.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:42.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:43.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:43.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:43.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:43.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:43.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:43.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:44.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:44.032+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:45.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:45.003+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:45.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:45.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:45.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:45.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:46.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:46.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:46.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:46.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:47.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:47.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:47.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:47.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:48.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:48.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:48.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:48.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:49.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:49.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:49.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:49.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:50.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:50.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:50.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:50.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:51.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:51.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:52.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:52.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:52.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:52.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:53.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:53.070+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:53.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:53.080+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:54.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:54.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:54.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:54.052+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:55.028 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:55.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:55.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:55.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:56.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:56.048+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:56.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:56.058+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:57.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:57.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:57.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:57.085+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:58.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:58.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:58.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:58.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:59.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:07:59.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:07:59.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:07:59.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:00.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:00.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:00.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:00.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:01.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:01.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:01.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:01.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:02.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:02.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:02.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:02.148+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:03.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:03.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:03.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:03.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:04.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:04.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:04.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:04.186+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:05.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:05.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:05.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:05.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:05.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:05.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:06.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:06.152+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:06.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:06.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:07.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:07.157+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:07.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:07.909+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:08.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:08.170+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:08.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:08.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:09.158 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:09.160+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:09.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:09.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:10.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:10.112+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:10.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:10.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:11.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:11.096+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:11.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:11.884+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:12.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:12.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:12.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:12.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:13.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:13.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:13.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:13.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:14.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:14.048+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:14.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:14.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:15.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:15.071+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:15.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:15.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:16.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:16.076+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:16.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:16.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:17.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:17.075+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:17.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:17.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:18.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:18.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:18.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:18.877+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:19.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:19.109+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:19.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:19.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:20.097 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:20.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:20.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:20.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:21.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:21.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:21.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:21.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:22.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:22.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:22.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:22.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:23.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:23.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:23.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:23.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:24.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:24.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:24.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:24.950+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:25.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:25.096+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:25.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:25.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:26.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:26.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:26.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:26.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:27.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:27.046+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:28.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:28.007+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:28.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:28.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:29.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:29.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:29.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:29.058+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:30.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:30.006+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:30.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:30.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:30.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:30.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:30.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:30.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:31.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:31.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:31.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:31.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:33.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:33.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:33.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:33.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:34.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:34.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:34.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:34.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:34.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:35.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:35.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:35.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:35.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:35.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:36.129 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:36.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:36.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:36.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:37.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:37.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:37.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:37.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:38.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:38.164+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:39.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:39.022+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:39.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:39.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:39.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:39.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:40.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:40.168+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:40.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:40.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:41.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:41.136+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:41.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:41.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:42.129 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:42.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:42.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:42.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:43.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:43.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:43.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:43.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:44.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:44.196+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:44.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:44.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:45.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:45.147+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:45.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:45.934+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:46.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:46.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:46.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:46.912+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:47.129 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:47.130+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:47.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:47.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:48.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:48.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:48.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:48.939+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:49.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:49.121+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:49.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:49.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:50.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:50.164+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:50.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:50.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:51.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:51.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:51.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:51.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:52.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:52.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:52.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:52.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:53.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:53.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:53.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:53.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:54.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:54.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:54.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:54.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:55.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:55.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:56.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:56.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:56.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:56.030+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:57.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:57.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:57.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:57.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:57.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:57.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:57.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:57.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:58.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:58.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:59.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:08:59.027+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:08:59.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:08:59.937+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:00.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:00.065+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:00.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:00.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:01.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:01.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:01.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:01.928+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:02.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:02.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:02.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:02.916+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:02.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:02.999+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:03.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:03.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:04.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:04.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:04.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:04.895+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:05.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:05.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:05.880 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:05.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:06.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:06.023+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:06.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:06.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:07.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:07.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:07.866 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:07.867+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:08.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:08.013+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:08.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:08.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:08.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:08.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:09.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:09.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:09.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:09.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:10.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:10.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:10.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:10.979+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:11.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:11.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:12.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:12.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:12.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:12.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:13.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:13.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:13.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:13.958+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:14.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:14.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:14.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:14.942+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:15.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:15.077+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:15.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:15.899+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:16.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:16.122+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:16.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:16.947+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:17.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:17.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:17.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:17.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:18.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:18.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:18.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:18.958+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:19.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:19.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:19.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:19.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:20.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:20.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:20.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:20.895+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:21.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:21.180+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:21.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:21.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:22.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:22.195+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:22.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:22.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:23.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:23.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:23.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:23.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:24.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:24.260+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:25.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:25.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:25.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:25.257+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:26.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:26.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:26.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:26.266+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:26.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:26.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:27.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:27.298+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:27.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:27.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:28.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:28.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:28.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:28.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:29.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:29.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:29.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:29.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:30.289 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:30.290+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:30.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:30.904+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:31.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:31.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:31.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:31.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:32.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:32.327+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:32.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:32.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:33.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:33.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:33.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:33.926+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:34.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:34.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:34.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:34.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:35.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:35.373+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:35.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:35.903+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:36.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:36.401+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:36.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:36.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:37.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:37.451+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:37.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:37.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:38.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:38.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:38.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:38.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:39.467 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:39.468+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:39.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:39.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:40.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:40.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:40.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:40.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:41.431 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:41.433+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:41.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:41.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:42.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:42.438+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:42.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:42.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:43.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:43.486+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:43.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:43.871+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:44.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:44.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:44.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:44.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:45.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:45.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:45.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:45.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:46.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:46.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:46.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:46.866+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:47.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:47.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:47.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:47.836+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:48.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:48.541+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:48.807 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:48.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:49.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:49.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:49.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:49.768+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:50.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:50.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:50.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:50.799+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:51.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:51.535+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:51.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:51.756+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:52.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:52.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:52.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:52.745+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:53.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:53.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:53.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:53.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:54.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:54.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:54.713 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:54.714+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:55.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:55.498+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:55.716 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:55.717+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:56.515 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:56.516+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:56.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:56.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:57.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:57.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:57.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:57.680+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:58.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:58.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:58.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:58.688+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:59.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:09:59.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:09:59.723 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:09:59.724+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:00.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:00.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:00.765 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:00.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:01.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:01.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:01.811 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:01.812+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:02.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:02.489+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:02.781 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:02.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:03.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:03.455+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:03.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:03.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:04.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:04.418+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:04.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:04.779+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:05.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:05.381+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:05.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:05.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:06.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:06.410+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:06.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:06.774+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:07.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:07.384+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:07.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:07.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:08.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:08.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:08.707 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:08.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:09.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:09.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:09.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:09.665+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:10.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:10.401+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:10.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:10.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:11.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:11.449+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:11.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:11.663+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:12.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:12.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:12.685 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:12.686+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:13.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:13.446+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:13.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:13.642+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:14.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:14.418+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:14.685 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:14.687+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:15.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:15.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:15.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:15.731+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:16.405 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:16.406+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:16.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:16.690+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:17.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:17.388+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:17.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:17.701+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:18.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:18.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:18.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:18.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:19.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:19.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:19.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:19.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:20.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:20.418+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:20.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:20.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:21.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:21.425+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:21.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:21.773+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:22.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:22.416+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:22.757 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:22.758+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:23.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:23.441+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:23.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:23.780+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:24.398 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:24.400+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:24.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:24.773+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:25.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:25.437+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:25.725 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:25.726+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:26.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:26.462+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:26.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:26.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:27.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:27.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:27.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:27.757+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:28.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:28.470+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:28.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:28.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:29.425 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:29.427+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:29.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:29.739+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:30.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:30.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:30.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:30.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:31.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:31.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:31.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:31.775+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:32.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:32.455+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:32.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:32.787+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:33.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:33.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:33.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:33.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:34.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:34.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:34.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:34.786+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:35.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:35.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:35.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:35.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:36.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:36.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:36.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:36.791+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:37.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:37.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:37.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:37.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:38.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:38.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:38.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:38.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:39.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:39.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:39.871 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:39.872+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:40.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:40.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:40.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:40.889+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:41.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:41.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:41.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:41.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:42.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:42.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:42.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:42.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:43.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:43.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:43.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:43.939+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:44.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:44.594+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:44.942 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:44.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:45.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:45.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:45.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:45.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:46.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:46.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:46.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:46.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:47.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:47.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:47.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:47.947+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:48.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:48.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:48.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:48.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:49.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:49.606+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:49.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:49.907+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:50.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:50.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:50.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:50.926+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:51.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:51.622+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:51.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:51.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:52.623 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:52.624+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:52.856 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:52.857+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:53.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:53.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:53.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:53.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:54.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:54.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:54.781 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:54.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:55.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:55.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:55.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:55.807+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:56.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:56.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:56.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:56.773+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:57.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:57.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:57.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:57.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:58.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:58.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:58.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:58.763+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:59.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:10:59.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:10:59.743 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:10:59.744+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:00.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:00.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:00.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:00.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:01.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:01.518+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:01.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:01.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:02.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:02.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:02.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:02.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:03.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:03.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:03.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:03.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:04.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:04.541+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:04.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:04.675+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:05.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:05.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:05.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:05.654+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:06.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:06.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:06.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:06.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:07.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:07.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:07.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:07.639+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:08.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:08.620+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:08.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:08.627+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:09.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:09.586+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:09.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:09.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:10.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:10.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:10.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:10.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:11.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:11.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:11.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:11.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:12.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:12.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:12.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:12.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:13.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:13.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:13.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:13.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:14.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:14.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:14.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:14.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:15.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:15.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:15.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:15.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:16.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:16.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:16.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:16.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:17.537 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:17.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:17.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:17.611+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:18.500 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:18.502+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:18.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:18.640+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:19.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:19.540+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:19.621 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:19.624+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:20.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:20.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:20.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:20.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:21.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:21.556+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:21.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:21.649+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:22.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:22.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:22.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:22.599+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:23.522 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:23.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:23.639 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:23.640+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:24.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:24.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:24.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:24.653+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:25.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:25.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:25.645 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:25.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:26.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:26.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:26.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:26.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:27.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:27.590+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:27.691 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:27.692+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:28.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:28.630+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:28.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:28.735+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:29.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:29.630+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:29.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:29.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:30.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:30.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:30.658 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:30.659+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:31.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:31.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:31.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:31.611+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:32.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:32.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:32.612 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:32.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:33.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:33.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:33.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:33.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:34.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:34.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:34.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:34.604+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:35.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:35.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:35.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:35.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:36.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:36.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:36.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:36.601+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:37.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:37.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:37.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:37.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:38.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:38.587+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:38.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:38.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:39.614 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:39.615+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:39.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:39.638+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:40.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:40.590+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:40.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:40.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:41.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:41.587+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:41.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:41.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:42.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:42.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:42.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:42.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:43.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:43.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:43.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:43.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:44.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:44.566+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:44.678 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:44.679+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:45.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:45.519+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:45.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:45.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:46.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:46.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:46.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:46.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:47.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:47.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:47.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:47.630+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:48.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:48.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:48.663 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:48.664+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:49.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:49.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:49.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:49.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:50.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:50.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:50.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:50.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:51.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:51.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:51.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:51.637+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:52.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:52.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:52.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:52.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:53.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:53.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:53.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:53.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:54.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:54.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:54.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:54.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:55.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:55.502+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:55.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:55.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:56.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:56.500+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:56.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:56.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:57.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:57.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:57.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:57.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:58.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:58.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:58.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:58.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:59.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:11:59.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:11:59.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:11:59.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:00.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:00.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:00.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:00.447+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:01.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:01.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:01.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:01.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:02.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:02.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:02.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:02.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:03.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:03.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:03.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:03.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:04.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:04.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:04.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:04.485+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:05.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:05.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:05.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:05.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:06.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:06.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:06.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:06.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:07.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:07.292+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:07.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:07.363+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:08.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:08.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:08.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:08.336+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:09.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:09.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:09.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:09.381+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:10.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:10.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:10.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:10.352+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:11.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:11.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:11.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:11.401+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:12.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:12.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:12.431 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:12.432+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:13.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:13.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:13.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:13.434+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:14.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:14.203+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:14.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:14.444+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:15.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:15.194+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:15.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:15.456+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:16.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:16.176+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:16.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:16.437+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:17.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:17.218+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:17.419 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:17.420+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:18.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:18.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:18.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:18.394+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:19.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:19.194+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:19.390 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:19.391+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:20.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:20.234+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:20.410 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:20.411+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:21.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:21.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:21.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:21.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:22.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:22.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:22.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:22.422+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:23.337 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:23.338+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:23.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:23.444+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:24.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:24.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:24.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:24.410+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:25.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:25.347+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:25.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:25.431+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:26.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:26.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:26.447 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:26.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:27.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:27.325+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:27.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:27.429+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:28.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:28.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:28.439 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:28.440+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:29.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:29.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:29.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:29.400+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:30.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:30.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:30.358 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:30.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:31.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:31.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:31.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:31.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:32.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:32.247+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:32.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:32.380+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:33.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:33.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:33.425 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:33.426+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:34.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:34.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:34.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:34.408+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:35.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:35.191+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:35.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:35.440+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:36.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:36.206+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:36.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:36.442+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:37.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:37.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:37.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:37.456+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:38.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:38.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:38.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:38.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:39.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:39.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:39.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:39.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:40.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:40.143+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:40.506 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:40.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:41.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:41.120+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:41.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:41.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:42.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:42.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:42.526 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:42.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:43.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:43.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:43.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:43.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:44.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:44.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:44.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:44.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:45.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:45.089+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:45.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:45.435+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:46.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:46.128+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:46.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:46.415+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:47.136 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:47.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:47.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:47.385+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:48.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:48.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:48.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:48.397+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:49.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:49.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:49.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:49.447+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:50.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:50.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:50.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:50.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:51.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:51.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:51.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:51.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:52.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:52.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:52.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:52.447+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:53.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:53.088+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:53.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:53.405+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:54.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:54.086+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:54.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:54.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:55.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:55.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:55.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:55.392+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:56.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:56.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:56.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:56.372+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:57.121 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:57.122+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:57.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:57.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:58.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:58.136+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:58.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:58.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:59.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:12:59.178+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:12:59.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:12:59.384+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:00.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:00.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:00.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:00.408+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:01.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:01.178+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:01.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:01.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:02.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:02.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:02.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:02.438+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:03.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:03.173+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:03.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:03.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:04.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:04.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:04.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:04.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:05.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:05.216+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:05.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:05.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:06.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:06.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:06.416 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:06.416+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:07.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:07.222+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:07.390 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:07.391+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:08.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:08.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:08.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:08.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:09.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:09.152+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:09.377 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:09.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:10.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:10.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:10.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:10.392+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:11.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:11.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:11.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:11.385+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:12.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:12.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:12.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:12.392+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:13.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:13.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:13.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:13.384+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:14.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:14.055+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:14.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:14.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:15.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:15.038+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:15.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:15.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:15.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:16.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:16.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:16.303+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:17.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:17.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:17.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:17.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:18.026 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:18.027+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:18.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:18.283+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:19.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:19.014+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:19.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:19.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:20.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:20.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:20.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:20.298+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:21.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:21.018+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:21.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:21.339+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:22.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:22.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:22.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:22.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:23.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:23.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:23.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:23.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:24.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:24.055+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:24.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:24.369+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:25.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:25.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:25.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:25.370+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:26.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:26.088+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:26.389 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:26.390+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:27.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:27.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:27.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:27.417+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:28.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:28.109+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:28.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:28.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:29.090 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:29.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:29.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:29.429+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:30.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:30.113+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:30.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:30.449+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:31.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:31.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:31.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:31.489+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:32.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:32.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:32.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:32.467+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:33.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:33.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:33.466 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:33.468+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:34.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:34.184+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:34.439 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:34.441+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:35.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:35.183+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:35.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:35.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:36.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:36.207+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:36.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:36.444+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:37.158 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:37.160+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:37.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:37.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:38.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:38.196+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:38.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:38.426+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:39.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:39.232+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:39.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:39.379+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:40.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:40.240+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:40.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:40.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:41.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:41.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:41.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:41.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:42.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:42.242+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:42.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:42.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:43.260 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:43.261+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:43.441 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:43.442+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:44.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:44.302+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:44.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:44.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:45.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:45.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:45.515 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:45.516+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:46.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:46.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:46.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:46.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:47.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:47.310+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:47.456 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:47.457+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:48.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:48.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:48.494 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:48.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:49.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:49.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:49.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:49.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:50.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:50.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:50.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:50.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:51.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:51.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:51.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:51.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:52.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:52.336+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:52.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:52.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:53.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:53.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:53.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:53.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:54.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:54.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:54.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:54.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:55.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:55.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:55.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:55.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:56.404 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:56.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:56.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:56.508+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:57.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:57.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:57.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:57.540+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:58.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:58.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:58.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:58.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:59.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:13:59.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:13:59.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:13:59.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:00.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:00.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:00.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:00.536+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:01.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:01.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:01.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:01.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:02.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:02.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:02.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:02.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:03.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:03.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:03.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:03.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:04.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:04.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:04.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:04.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:05.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:05.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:05.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:05.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:06.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:06.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:06.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:06.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:07.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:07.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:07.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:07.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:08.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:08.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:08.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:08.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:09.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:09.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:09.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:09.536+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:10.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:10.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:10.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:10.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:11.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:11.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:11.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:11.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:12.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:12.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:12.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:12.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:13.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:13.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:13.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:13.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:14.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:14.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:14.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:14.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:15.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:15.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:15.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:15.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:16.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:16.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:16.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:16.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:17.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:17.370+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:17.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:17.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:18.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:18.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:18.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:18.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:19.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:19.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:19.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:19.600+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:20.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:20.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:20.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:20.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:21.313 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:21.314+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:21.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:21.627+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:22.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:22.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:22.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:22.620+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:23.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:23.232+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:23.595 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:23.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:24.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:24.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:24.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:24.556+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:25.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:25.238+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:25.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:25.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:26.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:26.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:26.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:26.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:27.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:27.200+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:27.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:27.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:28.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:28.222+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:28.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:28.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:29.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:29.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:29.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:29.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:30.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:30.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:30.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:30.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:31.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:31.252+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:31.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:31.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:32.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:32.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:32.522 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:32.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:33.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:33.291+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:33.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:33.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:34.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:34.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:34.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:34.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:35.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:35.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:35.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:35.517+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:36.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:36.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:36.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:36.517+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:37.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:37.334+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:37.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:37.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:38.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:38.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:38.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:38.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:39.302 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:39.303+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:39.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:39.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:40.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:40.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:40.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:40.522+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:41.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:41.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:41.544 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:41.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:42.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:42.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:42.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:42.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:43.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:43.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:43.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:43.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:44.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:44.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:44.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:44.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:45.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:45.297+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:45.559 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:45.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:46.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:46.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:46.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:46.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:47.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:47.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:47.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:47.518+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:48.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:48.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:48.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:48.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:49.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:49.222+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:49.522 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:49.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:50.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:50.224+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:50.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:50.541+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:51.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:51.248+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:51.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:51.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:52.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:52.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:52.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:52.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:53.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:53.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:53.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:53.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:54.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:54.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:54.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:54.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:55.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:55.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:55.408 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:55.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:56.314 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:56.314+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:56.431 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:56.431+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:57.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:57.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:57.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:57.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:58.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:58.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:58.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:58.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:59.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:14:59.347+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:14:59.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:14:59.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:00.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:00.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:00.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:00.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:01.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:01.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:01.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:01.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:02.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:02.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:02.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:02.613+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:03.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:03.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:03.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:03.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:04.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:04.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:04.644 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:04.646+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:05.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:05.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:05.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:05.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:06.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:06.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:06.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:06.615+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:07.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:07.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:07.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:07.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:08.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:08.387+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:08.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:08.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:09.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:09.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:09.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:09.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:10.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:10.336+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:10.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:10.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:11.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:11.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:11.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:11.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:12.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:12.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:12.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:12.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:13.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:13.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:13.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:13.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:14.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:14.361+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:14.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:14.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:15.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:15.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:15.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:15.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:16.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:16.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:16.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:16.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:17.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:17.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:17.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:17.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:18.345 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:18.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:18.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:18.613+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:19.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:19.351+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:19.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:19.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:20.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:20.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:20.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:20.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:21.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:21.340+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:21.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:21.613+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:22.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:22.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:22.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:22.571+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:23.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:23.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:23.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:23.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:24.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:24.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:24.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:24.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:25.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:25.443+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:25.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:25.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:26.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:26.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:26.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:26.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:27.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:27.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:27.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:27.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:28.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:28.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:28.537 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:28.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:29.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:29.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:29.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:29.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:30.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:30.525+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:30.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:30.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:31.533 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:31.534+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:31.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:31.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:32.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:32.570+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:32.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:32.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:33.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:33.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:33.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:33.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:34.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:34.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:34.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:34.659+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:35.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:35.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:35.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:35.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:36.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:36.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:36.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:36.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:37.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:37.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:37.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:37.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:38.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:38.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:38.692 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:38.693+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:39.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:39.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:39.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:39.673+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:40.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:40.574+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:40.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:40.657+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:41.579 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:41.579+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:41.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:41.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:42.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:42.595+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:42.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:42.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:43.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:43.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:43.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:43.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:44.658 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:44.658+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:44.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:44.694+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:45.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:45.644+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:45.659 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:45.660+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:46.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:46.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:46.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:46.688+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:47.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:47.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:47.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:47.730+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:48.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:48.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:48.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:48.752+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:49.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:49.663+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:49.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:49.802+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:50.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:50.663+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:50.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:50.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:51.636 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:51.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:51.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:51.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:52.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:52.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:52.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:52.843+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:53.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:53.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:53.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:53.855+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:54.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:54.666+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:54.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:54.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:55.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:55.633+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:55.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:55.862+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:56.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:56.648+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:56.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:56.860+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:57.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:57.687+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:57.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:57.829+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:58.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:58.676+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:58.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:58.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:59.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:15:59.652+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:15:59.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:15:59.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:00.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:00.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:00.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:00.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:01.612 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:01.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:01.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:01.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:02.625 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:02.625+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:02.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:02.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:03.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:03.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:03.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:03.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:04.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:04.694+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:04.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:04.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:05.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:05.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:05.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:05.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:06.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:06.719+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:06.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:06.803+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:07.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:07.689+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:07.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:07.759+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:08.685 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:08.686+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:08.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:08.714+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:09.694 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:09.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:09.711 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:09.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:10.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:10.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:10.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:10.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:11.713 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:11.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:11.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:11.788+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:12.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:12.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:12.834 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:12.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:13.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:13.768+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:13.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:13.818+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:14.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:14.748+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:14.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:14.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:15.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:15.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:15.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:15.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:16.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:16.798+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:16.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:16.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:17.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:17.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:17.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:17.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:18.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:18.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:18.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:18.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:19.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:19.817+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:19.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:19.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:20.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:20.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:20.831 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:20.831+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:21.838 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:21.838+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:21.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:21.840+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:22.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:22.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:22.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:22.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:23.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:23.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:23.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:23.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:24.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:24.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:24.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:24.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:25.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:25.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:25.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:25.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:26.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:26.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:26.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:26.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:27.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:27.858+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:27.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:27.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:28.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:28.829+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:29.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:29.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:29.840 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:29.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:30.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:30.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:30.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:30.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:31.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:31.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:31.840 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:31.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:32.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:32.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:32.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:32.820+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:33.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:33.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:33.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:33.853+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:34.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:34.083+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:34.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:34.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:35.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:35.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:35.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:35.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:36.020 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:36.021+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:36.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:36.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:37.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:37.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:37.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:37.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:38.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:38.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:38.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:38.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:39.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:39.019+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:40.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:40.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:40.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:40.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:40.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:40.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:41.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:41.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:41.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:41.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:41.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:41.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:42.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:42.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:43.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:43.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:43.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:43.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:43.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:43.992+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:45.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:45.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:45.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:45.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:45.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:45.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:46.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:46.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:46.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:46.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:47.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:47.044+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:47.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:47.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:48.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:48.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:49.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:49.005+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:49.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:49.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:49.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:49.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:50.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:50.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:50.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:50.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:51.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:51.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:52.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:52.022+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:52.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:52.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:52.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:52.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:53.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:53.130+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:54.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:54.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:54.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:54.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:54.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:54.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:55.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:55.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:55.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:55.999+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:56.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:56.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:57.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:57.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:57.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:57.080+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:57.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:57.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:58.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:58.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:59.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:16:59.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:59.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:16:59.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:16:59.787 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T15:16:59.788+0000 7fcd7ebd3700 0 -- 172.21.15.69:0/2655470317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d45ba20e20 msgr2=0x55d45ba2f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-09-28T15:17:00.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:00.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:00.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:00.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:01.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:01.031+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:01.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:01.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:02.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:02.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:02.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:02.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:03.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:03.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:03.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:03.074+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:04.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:04.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:04.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:04.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:05.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:05.019+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:05.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:05.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:06.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:06.001+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:06.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:06.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:06.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:06.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:07.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:07.128+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:07.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:07.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:08.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:08.117+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:08.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:08.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:09.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:09.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:09.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:09.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:10.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:10.049+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:10.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:10.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:11.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:11.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:11.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:11.947+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:12.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:12.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:12.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:12.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:13.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:13.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:13.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:13.877+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:14.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:14.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:14.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:14.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:15.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:15.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:15.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:15.835+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:16.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:16.065+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:16.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:16.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:17.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:17.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:17.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:17.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:18.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:18.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:18.799 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:18.799+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:19.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:19.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:19.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:19.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:20.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:20.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:20.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:20.820+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:21.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:21.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:21.870 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:21.871+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:22.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:22.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:22.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:22.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:23.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:23.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:23.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:23.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:24.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:24.089+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:24.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:24.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:25.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:25.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:25.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:25.869+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:26.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:26.080+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:26.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:26.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:27.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:27.044+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:27.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:27.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:28.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:28.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:28.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:28.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:29.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:29.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:29.860 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:29.861+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:30.082 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:30.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:30.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:30.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:31.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:31.100+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:31.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:31.843+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:32.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:32.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:32.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:32.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:33.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:33.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:33.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:33.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:34.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:34.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:34.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:34.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:35.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:35.054+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:35.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:35.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:36.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:36.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:36.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:36.902+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:37.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:37.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:37.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:37.884+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:38.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:38.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:38.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:38.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:39.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:39.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:39.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:39.923+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:40.129 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:40.129+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:40.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:40.902+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:41.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:41.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:41.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:41.907+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:42.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:42.215+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:42.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:42.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:43.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:43.206+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:43.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:43.820+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:44.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:44.215+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:44.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:44.837+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:45.212 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:45.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:45.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:45.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:46.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:46.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:46.755 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:46.755+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:47.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:47.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:47.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:47.709+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:48.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:48.194+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:48.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:48.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:49.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:49.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:49.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:49.699+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:50.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:50.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:50.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:50.715+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:51.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:51.186+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:51.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:51.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:52.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:52.143+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:52.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:52.795+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:53.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:53.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:53.831 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:53.831+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:54.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:54.097+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:54.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:54.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:55.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:55.116+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:55.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:55.919+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:56.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:56.080+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:56.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:56.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:57.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:57.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:57.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:57.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:58.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:58.143+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:58.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:58.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:59.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:17:59.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:17:59.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:17:59.905+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:00.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:00.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:00.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:00.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:01.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:01.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:01.881 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:01.881+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:02.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:02.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:02.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:02.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:03.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:03.181+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:03.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:03.806+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:04.157 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:04.157+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:04.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:04.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:05.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:05.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:05.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:05.793+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:06.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:06.162+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:06.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:06.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:07.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:07.166+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:07.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:07.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:08.199 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:08.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:08.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:08.848+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:09.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:09.224+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:09.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:09.842+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:10.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:10.178+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:10.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:10.822+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:11.187 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:11.189+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:11.838 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:11.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:12.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:12.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:12.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:12.815+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:13.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:13.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:13.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:13.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:14.098 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:14.099+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:14.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:14.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:15.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:15.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:15.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:15.876+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:16.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:16.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:16.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:16.832+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:17.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:17.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:17.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:17.789+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:18.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:18.098+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:18.752 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:18.753+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:19.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:19.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:19.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:19.777+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:20.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:20.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:20.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:20.798+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:21.169 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:21.169+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:21.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:21.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:22.200 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:22.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:22.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:22.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:23.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:23.176+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:23.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:23.851+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:24.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:24.166+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:24.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:24.879+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:25.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:25.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:25.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:25.888+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:26.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:26.181+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:26.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:26.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:27.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:27.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:27.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:27.887+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:28.137 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:28.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:28.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:28.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:29.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:29.124+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:29.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:29.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:30.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:30.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:30.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:30.791+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:31.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:31.134+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:31.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:31.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:32.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:32.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:32.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:32.869+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:33.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:33.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:33.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:33.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:34.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:34.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:34.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:34.887+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:35.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:35.121+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:35.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:35.925+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:36.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:36.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:36.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:36.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:37.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:37.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:37.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:37.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:38.200 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:38.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:38.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:38.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:39.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:39.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:39.898 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:39.899+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:40.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:40.184+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:40.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:40.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:41.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:41.185+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:41.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:41.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:42.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:42.143+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:42.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:42.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:43.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:43.094+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:43.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:43.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:44.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:44.121+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:45.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:45.003+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:45.094 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:45.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:46.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:46.051+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:46.145 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:46.145+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:47.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:47.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:47.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:47.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:48.083 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:48.083+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:48.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:48.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:49.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:49.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:49.144 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:49.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:50.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:50.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:50.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:50.162+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:51.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:51.082+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:51.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:51.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:52.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:52.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:52.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:52.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:53.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:53.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:53.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:53.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:54.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:54.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:54.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:54.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:55.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:55.069+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:55.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:55.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:56.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:56.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:56.291 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:56.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:56.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:56.995+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:57.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:57.265+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:57.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:57.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:58.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:58.274+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:59.026 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:18:59.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:18:59.282 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:18:59.282+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:00.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:00.060+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:00.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:00.320+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:01.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:01.052+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:01.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:01.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:02.026 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:02.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:02.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:02.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:03.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:03.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:03.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:03.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:04.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:04.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:04.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:04.318+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:05.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:05.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:05.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:05.322+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:06.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:06.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:06.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:06.334+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:06.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:06.992+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:07.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:07.293+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:08.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:08.014+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:08.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:08.250+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:09.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:09.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:09.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:09.301+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:10.026 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:10.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:10.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:10.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:11.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:11.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:11.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:11.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:12.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:12.071+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:12.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:12.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:13.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:13.071+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:13.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:13.327+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:14.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:14.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:14.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:14.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:15.066 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:15.067+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:15.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:15.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:16.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:16.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:16.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:16.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:17.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:17.088+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:17.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:17.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:18.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:18.067+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:18.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:18.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:19.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:19.050+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:19.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:19.343+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:20.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:20.030+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:20.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:20.360+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:20.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:20.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:21.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:21.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:21.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:21.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:22.447 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:22.447+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:22.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:22.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:23.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:23.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:24.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:24.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:24.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:24.508+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:25.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:25.025+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:25.475 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:25.476+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:26.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:26.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:26.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:26.500+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:27.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:27.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:27.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:27.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:28.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:28.079+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:28.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:28.468+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:29.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:29.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:29.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:29.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:30.158 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:30.158+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:30.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:30.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:31.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:31.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:31.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:31.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:32.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:32.178+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:32.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:32.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:33.186 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:33.186+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:33.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:33.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:34.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:34.152+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:34.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:34.489+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:35.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:35.198+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:35.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:35.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:36.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:36.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:36.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:36.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:37.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:37.180+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:37.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:37.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:38.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:38.178+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:38.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:38.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:39.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:39.158+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:39.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:39.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:40.207 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:40.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:40.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:40.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:41.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:41.168+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:41.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:41.588+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:42.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:42.125+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:42.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:42.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:43.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:43.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:43.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:43.548+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:44.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:44.140+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:44.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:44.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:45.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:45.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:45.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:45.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:46.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:46.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:46.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:46.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:47.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:47.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:47.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:47.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:48.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:48.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:48.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:48.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:49.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:49.142+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:49.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:49.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:50.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:50.113+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:50.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:50.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:51.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:51.120+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:51.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:51.514+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:52.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:52.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:52.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:52.477+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:53.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:53.115+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:53.501 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:53.501+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:54.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:54.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:54.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:54.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:55.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:55.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:55.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:55.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:56.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:56.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:56.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:56.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:57.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:57.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:57.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:57.502+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:57.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:57.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:58.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:58.541+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:58.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:58.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:59.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:19:59.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:19:59.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:19:59.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:00.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:00.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:00.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:00.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:01.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:01.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:01.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:01.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:02.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:02.548+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:02.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:02.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:03.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:03.517+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:03.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:03.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:04.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:04.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:04.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:04.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:05.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:05.584+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:06.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:06.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:06.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:06.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:07.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:07.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:07.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:07.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:08.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:08.001+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:08.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:08.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:09.048 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:09.048+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:09.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:09.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:10.048 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:10.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:10.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:10.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:11.050 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:11.051+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:11.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:11.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:12.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:12.030+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:12.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:12.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:13.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:13.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:13.486 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:13.486+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:14.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:14.031+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:14.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:14.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:15.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:15.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:15.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:15.535+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:15.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:15.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:16.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:16.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:16.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:16.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:17.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:17.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:18.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:18.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:18.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:18.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:19.060 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:19.060+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:19.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:19.502+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:20.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:20.099+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:20.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:20.477+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:21.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:21.085+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:21.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:21.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:22.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:22.086+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:22.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:22.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:23.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:23.109+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:23.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:23.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:24.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:24.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:24.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:24.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:25.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:25.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:25.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:25.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:26.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:26.179+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:26.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:26.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:27.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:27.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:27.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:27.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:28.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:28.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:28.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:28.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:29.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:29.236+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:29.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:29.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:30.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:30.242+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:30.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:30.571+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:31.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:31.225+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:31.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:31.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:32.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:32.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:32.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:32.630+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:33.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:33.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:33.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:33.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:34.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:34.224+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:34.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:34.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:35.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:35.264+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:35.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:35.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:36.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:36.257+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:36.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:36.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:37.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:37.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:37.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:37.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:38.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:38.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:38.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:38.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:39.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:39.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:39.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:39.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:40.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:40.334+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:40.667 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:40.668+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:41.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:41.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:41.683 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:41.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:42.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:42.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:42.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:42.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:43.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:43.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:43.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:43.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:44.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:44.297+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:44.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:44.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:45.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:45.250+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:45.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:45.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:46.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:46.301+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:46.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:46.649+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:47.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:47.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:47.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:47.694+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:48.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:48.360+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:48.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:48.670+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:49.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:49.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:49.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:49.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:50.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:50.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:50.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:50.672+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:51.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:51.308+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:51.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:51.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:52.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:52.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:52.696 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:52.697+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:53.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:53.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:53.674 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:53.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:54.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:54.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:54.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:54.687+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:55.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:55.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:55.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:55.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:56.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:56.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:56.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:56.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:57.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:57.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:57.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:57.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:58.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:58.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:58.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:58.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:59.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:20:59.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:20:59.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:20:59.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:00.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:00.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:00.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:00.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:01.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:01.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:01.683 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:01.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:02.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:02.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:02.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:02.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:03.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:03.325+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:03.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:03.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:04.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:04.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:04.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:04.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:05.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:05.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:05.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:05.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:06.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:06.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:06.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:06.707+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:07.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:07.378+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:07.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:07.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:08.338 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:08.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:08.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:08.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:09.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:09.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:09.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:09.717+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:10.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:10.282+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:10.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:10.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:11.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:11.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:11.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:11.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:12.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:12.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:12.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:12.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:13.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:13.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:13.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:13.685+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:14.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:14.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:14.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:14.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:15.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:15.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:15.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:15.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:16.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:16.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:16.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:16.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:17.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:17.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:17.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:17.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:18.378 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:18.378+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:18.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:18.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:19.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:19.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:19.745 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:19.743+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:20.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:20.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:20.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:20.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:21.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:21.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:21.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:21.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:22.379 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:22.379+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:22.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:22.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:23.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:23.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:23.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:23.693+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:24.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:24.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:24.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:24.673+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:25.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:25.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:25.695 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:25.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:26.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:26.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:26.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:26.662+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:27.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:27.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:27.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:27.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:28.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:28.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:28.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:28.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:29.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:29.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:29.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:29.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:30.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:30.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:30.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:30.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:31.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:31.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:31.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:31.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:32.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:32.452+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:32.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:32.502+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:33.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:33.403+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:33.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:33.505+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:34.398 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:34.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:34.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:34.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:35.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:35.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:35.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:35.541+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:36.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:36.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:36.500 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:36.501+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:37.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:37.347+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:37.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:37.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:38.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:38.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:38.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:38.514+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:39.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:39.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:39.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:39.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:40.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:40.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:40.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:40.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:41.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:41.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:41.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:41.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:42.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:42.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:42.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:42.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:43.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:43.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:43.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:43.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:44.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:44.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:44.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:44.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:45.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:45.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:45.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:45.588+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:46.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:46.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:46.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:46.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:47.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:47.293+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:47.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:47.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:48.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:48.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:48.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:48.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:49.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:49.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:49.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:49.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:50.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:50.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:50.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:50.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:51.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:51.225+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:51.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:51.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:52.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:52.238+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:52.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:52.571+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:53.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:53.236+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:53.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:53.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:54.186 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:54.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:54.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:54.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:55.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:55.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:55.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:55.500+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:56.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:56.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:56.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:56.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:57.245 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:57.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:57.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:57.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:58.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:58.228+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:58.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:58.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:59.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:21:59.216+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:21:59.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:21:59.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:00.174 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:00.175+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:00.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:00.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:01.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:01.157+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:01.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:01.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:02.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:02.112+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:02.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:02.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:03.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:03.122+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:03.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:03.522+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:04.172 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:04.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:04.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:04.489+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:05.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:05.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:05.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:05.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:06.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:06.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:06.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:06.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:07.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:07.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:07.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:07.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:08.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:08.175+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:08.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:08.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:09.228 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:09.216+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:09.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:09.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:10.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:10.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:10.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:10.592+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:11.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:11.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:11.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:11.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:12.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:12.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:12.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:12.656+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:13.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:13.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:13.642 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:13.642+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:14.179 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:14.179+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:14.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:14.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:15.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:15.183+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:15.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:15.611+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:16.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:16.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:16.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:16.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:17.228 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:17.229+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:17.618 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:17.618+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:18.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:18.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:18.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:18.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:19.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:19.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:19.636 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:19.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:20.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:20.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:20.663 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:20.663+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:21.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:21.120+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:21.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:21.714+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:22.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:22.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:22.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:22.700+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:23.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:23.108+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:23.661 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:23.661+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:24.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:24.077+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:24.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:24.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:25.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:25.081+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:25.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:25.673+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:26.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:26.094+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:26.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:26.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:27.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:27.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:27.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:27.752+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:28.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:28.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:28.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:28.767+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:29.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:29.131+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:29.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:29.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:30.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:30.082+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:30.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:30.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:31.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:31.080+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:31.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:31.772+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:32.066 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:32.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:32.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:32.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:33.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:33.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:33.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:33.776+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:34.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:34.129+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:34.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:34.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:35.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:35.113+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:35.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:35.773+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:36.083 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:36.083+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:36.732 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:36.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:37.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:37.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:37.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:37.714+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:38.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:38.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:38.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:38.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:39.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:39.133+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:39.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:39.685+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:40.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:40.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:40.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:40.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:41.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:41.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:41.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:41.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:42.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:42.120+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:42.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:42.759+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:43.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:43.143+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:43.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:43.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:44.095 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:44.096+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:44.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:44.767+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:45.056 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:45.058+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:45.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:45.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:46.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:46.097+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:46.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:46.767+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:47.105 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:47.104+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:47.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:47.798+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:48.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:48.108+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:48.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:48.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:49.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:49.089+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:49.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:49.772+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:50.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:50.117+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:50.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:50.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:51.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:51.076+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:51.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:51.846+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:52.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:52.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:52.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:52.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:53.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:53.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:53.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:53.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:54.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:54.076+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:54.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:54.902+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:55.091 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:55.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:55.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:55.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:56.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:56.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:56.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:56.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:57.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:57.094+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:57.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:57.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:58.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:58.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:58.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:58.824+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:59.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:22:59.104+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:22:59.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:22:59.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:00.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:00.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:00.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:00.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:01.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:01.181+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:01.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:01.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:02.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:02.194+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:02.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:02.900+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:03.179 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:03.179+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:03.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:03.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:04.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:04.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:04.988 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:04.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:05.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:05.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:06.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:06.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:06.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:06.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:07.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:07.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:07.170 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:07.170+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:07.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:07.965+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:08.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:08.183+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:09.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:09.007+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:09.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:09.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:09.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:09.986+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:10.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:10.239+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:11.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:11.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:11.270 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:11.270+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:12.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:12.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:12.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:12.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:13.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:13.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:13.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:13.280+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:14.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:14.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:14.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:14.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:15.054 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:15.054+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:15.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:15.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:16.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:16.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:16.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:16.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:17.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:17.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:17.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:17.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:17.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:17.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:18.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:18.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:18.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:18.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:19.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:19.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:19.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:19.999+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:20.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:20.312+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:20.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:20.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:21.344 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:21.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:21.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:21.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:22.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:22.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:22.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:22.925+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:23.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:23.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:23.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:23.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:24.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:24.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:24.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:24.935+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:25.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:25.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:25.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:25.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:26.331 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:26.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:26.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:26.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:27.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:27.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:27.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:27.862+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:28.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:28.337+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:28.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:28.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:29.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:29.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:29.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:29.833+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:30.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:30.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:30.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:30.866+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:31.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:31.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:31.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:31.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:32.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:32.387+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:32.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:32.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:33.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:33.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:33.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:33.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:34.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:34.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:34.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:34.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:35.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:35.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:35.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:35.843+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:36.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:36.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:36.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:36.855+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:37.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:37.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:37.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:37.904+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:38.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:38.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:38.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:38.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:39.566 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:39.566+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:39.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:39.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:40.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:40.569+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:40.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:40.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:41.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:41.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:41.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:41.966+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:42.566 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:42.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:42.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:42.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:43.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:43.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:44.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:44.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:44.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:44.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:45.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:45.074+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:45.530 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:45.530+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:46.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:46.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:46.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:46.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:47.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:47.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:47.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:47.493+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:48.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:48.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:48.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:48.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:49.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:49.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:49.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:49.546+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:50.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:50.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:50.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:50.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:51.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:51.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:51.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:51.580+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:52.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:52.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:52.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:52.589+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:53.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:53.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:53.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:53.606+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:54.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:54.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:54.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:54.606+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:55.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:55.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:55.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:55.574+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:56.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:56.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:56.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:56.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:57.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:57.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:57.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:57.529+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:58.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:58.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:58.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:58.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:59.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:23:59.077+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:23:59.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:23:59.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:00.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:00.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:00.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:00.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:01.111 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:01.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:01.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:01.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:02.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:02.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:02.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:02.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:03.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:03.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:03.341 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:03.342+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:04.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:04.088+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:04.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:04.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:05.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:05.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:05.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:05.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:06.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:06.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:06.330 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:06.330+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:07.115 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:07.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:07.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:07.370+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:08.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:08.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:08.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:08.412+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:09.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:09.100+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:09.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:09.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:10.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:10.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:10.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:10.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:11.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:11.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:11.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:11.466+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:12.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:12.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:12.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:12.473+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:13.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:13.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:13.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:13.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:14.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:14.065+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:14.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:14.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:15.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:15.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:15.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:15.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:16.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:16.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:16.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:16.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:17.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:17.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:17.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:17.505+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:18.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:18.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:18.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:18.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:19.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:19.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:19.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:19.560+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:20.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:20.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:20.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:20.592+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:21.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:21.158+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:21.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:21.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:22.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:22.185+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:22.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:22.570+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:23.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:23.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:23.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:23.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:24.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:24.220+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:24.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:24.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:25.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:25.261+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:25.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:25.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:26.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:26.227+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:26.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:26.488+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:27.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:27.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:27.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:27.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:28.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:28.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:28.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:28.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:29.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:29.283+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:29.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:29.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:30.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:30.270+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:30.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:30.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:31.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:31.290+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:31.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:31.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:32.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:32.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:32.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:32.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:33.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:33.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:33.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:33.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:34.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:34.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:34.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:34.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:35.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:35.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:35.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:35.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:36.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:36.288+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:36.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:36.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:37.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:37.303+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:37.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:37.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:38.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:38.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:38.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:38.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:39.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:39.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:39.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:39.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:40.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:40.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:40.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:40.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:41.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:41.327+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:41.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:41.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:42.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:42.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:42.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:42.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:43.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:43.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:43.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:43.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:44.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:44.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:44.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:44.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:45.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:45.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:45.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:45.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:46.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:46.312+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:46.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:46.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:47.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:47.348+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:47.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:47.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:48.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:48.360+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:48.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:48.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:49.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:49.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:49.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:49.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:50.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:50.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:50.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:50.371+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:51.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:51.361+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:51.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:51.411+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:52.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:52.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:52.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:52.368+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:53.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:53.346+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:53.363 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:53.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:54.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:54.334+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:54.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:54.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:55.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:55.362+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:55.376 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:55.377+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:56.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:56.343+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:56.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:56.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:57.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:57.346+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:57.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:57.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:58.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:58.316+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:58.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:58.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:59.275 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:24:59.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:24:59.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:24:59.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:00.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:00.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:00.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:00.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:01.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:01.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:01.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:01.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:02.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:02.301+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:02.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:02.417+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:03.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:03.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:03.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:03.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:04.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:04.277+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:04.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:04.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:05.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:05.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:05.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:05.388+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:06.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:06.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:06.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:06.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:07.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:07.339+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:07.358 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:07.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:08.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:08.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:08.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:08.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:09.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:09.257+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:09.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:09.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:10.240 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:10.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:10.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:10.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:11.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:11.206+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:11.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:11.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:12.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:12.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:12.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:12.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:13.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:13.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:13.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:13.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:14.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:14.188+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:14.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:14.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:15.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:15.164+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:15.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:15.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:16.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:16.189+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:16.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:16.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:17.157 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:17.157+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:17.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:17.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:18.178 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:18.178+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:18.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:18.285+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:19.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:19.225+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:19.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:19.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:20.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:20.179+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:20.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:20.222+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:21.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:21.143+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:21.210 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:21.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:22.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:22.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:22.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:22.209+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:23.111 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:23.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:23.172 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:23.173+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:24.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:24.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:24.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:24.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:25.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:25.101+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:25.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:25.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:26.144 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:26.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:26.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:26.148+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:27.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:27.102+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:27.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:27.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:28.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:28.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:28.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:28.180+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:29.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:29.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:29.151 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:29.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:30.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:30.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:30.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:30.106+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:31.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:31.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:31.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:31.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:32.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:32.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:32.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:32.162+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:33.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:33.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:33.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:33.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:34.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:34.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:34.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:34.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:35.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:35.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:35.143 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:35.143+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:36.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:36.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:36.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:36.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:37.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:37.062+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:37.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:37.069+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:38.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:38.018+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:38.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:38.077+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:39.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:39.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:39.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:39.092+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:40.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:40.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:40.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:40.128+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:40.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:40.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:41.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:41.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:41.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:41.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:42.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:42.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:42.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:42.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:43.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:43.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:43.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:43.912+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:44.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:44.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:44.947 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:44.948+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:45.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:45.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:45.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:45.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:46.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:46.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:47.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:47.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:47.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:47.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:48.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:48.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:48.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:48.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:49.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:49.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:49.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:49.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:50.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:50.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:50.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:50.069+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:51.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:51.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:51.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:51.053+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:52.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:52.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:52.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:52.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:53.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:53.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:53.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:53.059+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:54.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:54.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:54.080 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:54.080+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:55.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:55.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:55.091 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:55.091+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:56.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:56.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:56.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:56.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:57.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:57.077+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:57.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:57.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:58.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:58.058+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:58.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:58.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:59.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:25:59.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:25:59.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:25:59.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:00.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:00.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:00.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:00.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:00.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:00.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:01.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:01.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:02.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:02.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:02.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:02.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:02.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:02.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:03.082 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:03.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:03.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:03.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:04.111 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:04.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:04.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:04.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:05.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:05.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:05.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:05.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:06.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:06.120+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:06.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:06.932+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:07.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:07.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:07.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:07.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:08.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:08.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:08.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:08.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:09.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:09.062+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:09.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:09.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:10.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:10.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:11.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:11.001+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:11.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:11.003+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:11.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:11.974+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:12.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:12.025+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:12.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:12.995+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:12.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:12.996+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:14.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:14.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:14.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:14.023+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:15.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:15.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:15.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:15.062+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:16.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:16.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:16.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:16.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:16.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:16.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:17.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:17.080+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:17.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:17.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:18.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:18.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:18.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:18.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:19.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:19.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:19.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:19.973+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:20.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:20.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:21.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:21.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:21.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:21.123+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:21.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:21.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:22.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:22.117+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:22.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:22.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:23.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:23.106+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:23.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:23.887+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:24.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:24.076+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:24.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:24.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:25.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:25.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:25.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:25.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:26.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:26.147+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:26.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:26.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:27.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:27.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:27.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:27.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:28.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:28.169+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:28.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:28.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:29.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:29.185+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:29.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:29.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:30.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:30.194+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:30.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:30.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:31.198 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:31.199+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:31.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:31.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:32.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:32.219+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:32.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:32.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:33.230 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:33.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:33.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:33.995+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:34.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:34.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:34.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:34.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:35.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:35.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:35.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:35.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:36.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:36.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:36.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:36.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:37.301 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:37.301+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:37.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:37.973+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:38.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:38.270+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:38.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:38.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:39.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:39.298+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:39.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:39.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:40.267 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:40.267+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:40.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:40.892+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:41.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:41.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:41.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:41.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:42.258 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:42.258+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:42.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:42.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:43.212 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:43.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:43.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:43.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:44.230 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:44.230+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:44.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:44.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:45.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:45.184+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:45.858 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:45.858+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:46.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:46.232+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:46.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:46.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:47.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:47.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:47.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:47.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:48.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:48.271+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:48.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:48.784+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:49.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:49.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:49.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:49.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:50.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:50.225+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:50.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:50.767+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:51.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:51.220+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:51.733 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:51.733+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:52.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:52.218+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:52.697 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:52.697+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:53.231 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:53.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:53.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:53.694+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:54.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:54.184+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:54.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:54.700+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:55.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:55.152+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:55.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:55.670+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:56.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:56.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:56.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:56.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:57.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:57.142+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:57.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:57.622+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:58.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:58.188+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:58.652 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:58.652+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:59.190 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:26:59.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:26:59.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:26:59.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:00.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:00.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:00.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:00.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:01.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:01.147+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:01.728 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:01.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:02.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:02.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:02.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:02.699+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:03.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:03.166+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:03.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:03.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:04.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:04.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:04.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:04.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:05.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:05.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:05.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:05.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:06.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:06.117+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:06.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:06.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:07.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:07.146+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:07.677 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:07.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:08.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:08.103+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:08.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:08.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:09.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:09.147+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:09.602 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:09.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:10.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:10.148+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:10.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:10.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:11.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:11.191+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:11.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:11.596+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:12.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:12.226+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:12.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:12.642+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:13.220 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:13.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:13.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:13.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:14.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:14.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:14.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:14.644+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:15.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:15.217+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:15.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:15.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:16.229 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:16.230+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:16.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:16.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:17.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:17.211+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:17.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:17.676+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:18.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:18.168+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:18.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:18.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:19.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:19.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:19.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:19.716+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:20.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:20.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:20.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:20.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:21.136 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:21.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:21.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:21.737+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:22.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:22.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:22.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:22.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:23.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:23.083+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:23.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:23.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:24.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:24.052+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:24.713 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:24.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:25.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:25.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:25.747 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:25.747+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:26.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:26.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:26.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:26.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:27.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:27.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:27.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:27.785+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:28.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:28.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:28.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:28.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:29.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:29.134+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:29.777 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:29.777+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:30.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:30.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:30.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:30.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:31.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:31.142+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:31.775 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:31.775+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:32.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:32.162+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:32.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:32.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:33.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:33.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:33.830 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:33.830+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:34.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:34.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:34.860 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:34.860+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:35.199 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:35.199+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:35.814 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:35.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:36.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:36.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:36.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:36.857+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:37.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:37.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:37.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:37.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:38.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:38.176+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:38.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:38.893+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:39.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:39.166+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:39.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:39.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:40.144 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:40.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:40.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:40.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:41.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:41.188+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:41.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:41.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:42.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:42.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:42.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:42.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:43.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:43.222+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:43.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:43.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:44.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:44.250+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:44.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:44.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:45.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:45.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:45.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:45.972+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:46.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:46.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:46.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:46.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:47.321 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:47.321+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:47.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:47.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:48.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:48.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:48.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:48.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:49.321 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:49.321+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:49.919 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:49.919+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:50.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:50.320+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:50.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:50.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:51.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:51.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:51.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:51.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:52.389 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:52.389+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:52.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:52.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:53.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:53.388+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:53.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:53.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:54.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:54.421+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:54.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:54.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:55.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:55.444+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:55.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:55.889+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:56.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:56.407+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:56.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:56.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:57.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:57.401+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:57.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:57.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:58.416 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:58.417+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:58.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:58.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:59.456 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:27:59.457+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:27:59.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:27:59.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:00.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:00.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:00.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:00.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:01.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:01.447+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:01.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:01.912+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:02.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:02.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:02.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:02.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:03.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:03.482+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:03.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:03.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:04.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:04.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:04.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:04.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:05.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:05.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:05.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:05.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:06.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:06.498+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:06.911 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:06.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:07.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:07.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:07.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:07.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:08.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:08.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:08.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:08.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:09.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:09.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:09.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:09.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:10.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:10.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:10.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:10.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:11.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:11.505+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:11.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:11.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:12.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:12.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:13.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:13.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:13.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:13.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:13.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:13.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:14.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:14.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:15.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:15.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:15.485 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:15.485+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:16.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:16.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:16.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:16.476+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:17.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:17.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:17.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:17.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:18.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:18.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:18.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:18.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:19.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:19.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:19.472 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:19.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:20.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:20.031+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:20.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:20.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:20.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:20.999+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:21.479 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:21.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:21.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:21.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:22.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:22.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:22.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:22.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:23.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:23.474+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:23.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:23.958+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:24.486 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:24.486+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:24.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:24.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:25.529 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:25.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:25.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:25.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:26.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:26.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:26.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:26.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:27.515 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:27.515+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:27.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:27.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:28.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:28.560+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:28.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:28.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:29.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:29.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:29.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:29.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:30.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:30.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:30.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:30.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:31.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:31.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:31.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:31.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:32.526 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:32.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:32.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:32.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:33.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:33.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:33.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:33.923+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:34.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:34.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:34.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:34.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:35.639 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:35.638+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:35.920 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:35.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:36.667 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:36.666+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:36.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:36.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:37.635 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:37.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:37.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:37.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:38.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:38.681+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:38.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:38.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:39.707 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:39.707+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:40.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:40.014+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:40.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:40.717+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:41.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:41.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:41.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:41.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:42.048 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:42.048+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:42.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:42.751+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:43.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:43.095+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:43.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:43.776+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:44.072 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:44.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:44.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:44.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:45.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:45.083+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:45.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:45.770+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:46.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:46.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:46.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:46.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:47.083 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:47.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:47.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:47.777+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:48.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:48.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:48.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:48.777+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:49.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:49.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:49.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:49.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:50.172 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:50.173+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:50.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:50.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:51.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:51.178+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:51.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:51.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:52.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:52.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:52.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:52.763+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:53.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:53.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:53.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:53.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:54.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:54.232+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:54.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:54.802+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:55.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:55.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:55.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:55.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:56.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:56.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:56.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:56.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:57.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:57.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:57.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:57.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:58.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:58.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:58.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:58.752+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:59.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:28:59.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:28:59.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:28:59.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:00.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:00.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:00.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:00.788+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:01.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:01.106+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:01.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:01.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:02.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:02.124+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:02.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:02.796+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:03.089 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:03.089+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:03.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:03.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:04.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:04.134+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:04.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:04.814+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:05.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:05.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:05.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:05.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:06.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:06.163+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:06.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:06.777+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:07.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:07.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:07.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:07.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:08.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:08.189+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:08.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:08.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:09.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:09.185+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:09.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:09.837+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:10.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:10.198+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:10.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:10.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:11.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:11.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:11.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:11.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:12.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:12.238+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:12.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:12.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:13.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:13.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:13.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:13.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:14.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:14.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:14.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:14.935+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:15.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:15.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:15.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:15.919+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:16.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:16.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:16.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:16.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:17.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:17.235+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:17.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:17.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:18.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:18.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:18.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:18.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:19.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:19.209+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:19.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:19.919+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:20.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:20.221+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:20.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:20.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:21.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:21.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:21.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:21.937+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:22.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:22.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:22.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:22.974+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:23.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:23.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:23.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:23.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:24.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:24.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:24.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:24.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:25.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:25.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:25.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:25.984+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:26.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:26.221+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:26.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:26.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:27.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:27.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:27.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:27.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:28.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:28.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:28.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:28.942+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:29.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:29.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:29.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:29.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:30.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:30.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:30.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:30.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:31.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:31.340+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:31.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:31.981+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:32.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:32.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:33.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:33.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:33.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:33.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:34.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:34.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:34.327 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:34.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:35.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:35.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:35.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:35.340+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:36.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:36.097+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:36.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:36.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:37.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:37.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:37.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:37.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:38.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:38.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:38.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:38.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:39.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:39.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:39.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:39.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:40.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:40.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:40.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:40.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:41.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:41.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:41.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:41.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:41.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:41.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:42.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:42.308+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:42.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:42.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:43.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:43.283+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:43.951 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:43.950+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:44.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:44.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:44.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:44.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:45.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:45.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:46.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:46.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:46.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:46.351+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:46.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:46.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:47.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:47.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:48.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:48.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:48.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:48.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:49.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:49.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:49.383 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:49.383+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:50.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:50.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:50.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:50.408+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:51.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:51.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:51.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:51.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:52.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:52.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:52.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:52.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:53.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:53.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:53.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:53.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:54.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:54.083+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:54.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:54.452+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:55.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:55.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:55.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:55.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:56.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:56.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:56.442 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:56.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:57.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:57.015+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:57.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:57.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:58.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:58.048+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:58.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:58.487+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:59.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:29:59.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:29:59.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:29:59.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:00.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:00.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:00.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:00.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:01.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:01.120+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:01.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:01.488+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:02.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:02.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:02.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:02.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:03.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:03.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:03.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:03.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:04.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:04.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:04.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:04.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:05.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:05.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:05.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:05.573+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:06.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:06.152+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:06.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:06.583+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:07.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:07.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:07.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:07.560+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:08.135 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:08.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:08.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:08.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:09.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:09.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:09.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:09.591+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:10.122 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:10.122+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:10.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:10.635+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:11.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:11.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:11.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:11.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:12.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:12.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:12.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:12.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:13.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:13.128+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:13.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:13.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:14.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:14.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:14.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:14.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:15.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:15.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:15.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:15.513+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:16.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:16.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:16.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:16.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:17.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:17.054+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:17.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:17.489+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:18.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:18.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:18.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:18.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:18.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:18.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:19.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:19.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:20.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:20.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:20.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:20.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:20.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:20.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:21.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:21.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:21.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:21.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:22.454 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:22.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:23.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:23.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:23.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:23.443+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:24.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:24.053+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:24.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:24.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:25.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:25.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:25.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:25.450+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:26.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:26.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:26.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:26.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:27.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:27.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:27.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:27.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:28.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:28.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:28.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:28.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:29.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:29.092+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:29.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:29.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:30.091 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:30.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:30.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:30.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:31.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:31.116+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:31.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:31.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:32.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:32.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:32.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:32.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:33.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:33.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:33.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:33.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:34.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:34.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:34.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:34.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:35.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:35.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:35.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:35.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:36.081 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:36.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:36.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:36.408+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:37.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:37.120+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:37.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:37.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:38.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:38.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:38.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:38.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:39.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:39.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:39.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:39.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:40.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:40.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:40.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:40.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:41.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:41.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:41.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:41.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:42.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:42.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:42.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:42.408+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:43.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:43.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:43.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:43.417+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:44.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:44.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:44.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:44.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:45.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:45.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:45.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:45.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:46.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:46.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:46.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:46.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:47.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:47.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:47.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:47.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:48.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:48.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:48.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:48.443+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:49.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:49.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:49.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:49.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:50.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:50.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:50.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:50.451+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:51.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:51.051+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:51.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:51.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:52.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:52.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:52.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:52.473+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:53.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:53.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:53.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:53.461+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:54.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:54.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:54.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:54.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:55.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:55.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:55.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:55.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:56.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:56.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:56.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:56.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:57.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:57.023+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:57.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:57.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:57.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:57.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:58.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:58.470+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:59.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:30:59.021+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:30:59.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:30:59.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:00.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:00.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:00.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:00.473+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:01.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:01.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:01.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:01.493+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:02.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:02.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:02.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:02.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:03.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:03.075+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:03.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:03.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:04.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:04.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:04.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:04.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:05.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:05.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:05.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:05.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:06.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:06.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:06.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:06.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:07.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:07.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:07.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:07.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:08.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:08.134+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:08.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:08.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:09.122 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:09.122+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:09.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:09.451+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:10.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:10.120+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:10.481 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:10.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:11.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:11.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:11.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:11.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:12.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:12.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:12.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:12.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:13.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:13.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:13.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:13.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:13.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:13.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:14.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:14.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:14.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:14.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:15.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:15.534+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:15.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:15.971+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:16.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:16.522+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:17.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:17.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:17.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:17.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:18.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:18.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:18.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:18.506+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:19.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:19.052+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:19.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:19.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:20.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:20.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:20.575 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:20.575+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:21.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:21.015+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:21.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:21.592+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:22.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:22.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:22.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:22.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:23.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:23.077+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:23.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:23.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:24.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:24.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:24.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:24.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:25.045 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:25.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:25.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:25.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:26.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:26.055+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:26.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:26.644+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:27.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:27.027+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:27.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:27.652+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:28.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:28.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:28.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:28.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:29.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:29.013+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:29.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:29.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:30.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:30.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:30.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:30.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:31.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:31.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:31.662 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:31.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:32.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:32.048+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:32.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:32.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:33.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:33.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:33.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:33.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:34.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:34.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:34.660 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:34.660+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:35.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:35.036+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:35.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:35.623+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:36.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:36.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:36.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:36.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:37.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:37.062+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:37.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:37.644+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:38.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:38.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:38.602 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:38.602+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:39.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:39.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:39.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:39.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:39.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:39.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:40.646 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:40.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:40.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:40.992+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:41.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:41.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:41.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:41.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:42.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:42.619+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:42.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:42.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:43.625 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:43.625+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:44.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:44.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:44.633 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:44.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:45.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:45.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:45.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:45.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:46.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:46.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:46.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:46.721+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:47.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:47.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:47.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:47.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:48.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:48.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:48.795 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:48.796+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:49.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:49.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:49.827 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:49.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:50.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:50.062+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:50.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:50.826+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:51.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:51.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:51.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:51.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:52.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:52.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:52.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:52.785+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:53.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:53.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:53.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:53.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:53.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:53.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:54.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:54.753+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:55.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:55.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:55.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:55.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:56.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:56.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:56.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:56.744+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:57.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:57.069+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:57.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:57.729+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:58.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:58.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:58.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:58.694+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:59.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:31:59.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:31:59.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:31:59.702+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:00.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:00.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:00.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:00.687+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:01.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:01.088+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:01.733 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:01.733+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:02.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:02.134+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:02.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:02.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:03.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:03.120+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:03.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:03.727+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:04.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:04.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:04.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:04.760+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:05.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:05.076+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:05.743 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:05.743+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:06.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:06.116+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:06.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:06.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:07.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:07.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:07.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:07.693+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:08.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:08.153+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:08.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:08.717+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:09.195 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:09.195+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:09.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:09.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:10.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:10.168+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:10.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:10.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:11.213 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:11.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:11.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:11.694+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:12.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:12.173+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:12.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:12.724+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:13.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:13.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:13.689 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:13.689+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:14.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:14.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:14.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:14.680+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:15.260 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:15.260+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:15.731 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:15.731+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:16.242 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:16.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:16.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:16.737+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:17.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:17.255+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:17.691 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:17.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:18.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:18.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:18.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:18.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:19.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:19.259+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:19.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:19.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:20.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:20.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:20.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:20.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:21.242 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:21.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:21.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:21.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:22.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:22.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:22.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:22.642+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:23.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:23.244+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:23.673 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:23.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:24.240 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:24.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:24.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:24.722+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:25.198 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:25.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:25.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:25.730+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:26.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:26.166+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:26.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:26.759+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:27.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:27.191+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:27.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:27.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:28.145 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:28.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:28.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:28.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:29.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:29.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:29.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:29.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:30.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:30.179+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:30.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:30.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:31.182 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:31.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:31.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:31.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:32.186 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:32.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:32.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:32.844+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:33.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:33.153+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:33.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:33.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:34.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:34.169+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:34.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:34.795+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:35.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:35.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:35.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:35.822+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:36.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:36.097+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:36.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:36.785+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:37.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:37.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:37.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:37.747+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:38.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:38.089+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:38.707 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:38.707+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:39.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:39.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:39.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:39.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:40.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:40.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:40.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:40.762+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:41.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:41.147+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:41.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:41.760+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:42.198 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:42.198+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:42.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:42.735+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:43.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:43.170+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:43.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:43.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:44.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:44.148+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:44.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:44.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:45.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:45.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:45.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:45.835+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:46.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:46.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:46.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:46.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:47.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:47.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:47.836 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:47.836+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:48.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:48.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:48.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:48.865+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:49.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:49.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:49.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:49.904+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:50.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:50.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:50.859 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:50.858+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:51.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:51.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:51.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:51.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:52.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:52.076+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:52.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:52.885+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:53.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:53.065+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:53.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:53.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:54.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:54.113+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:54.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:54.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:55.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:55.080+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:55.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:55.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:56.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:56.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:56.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:56.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:57.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:57.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:57.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:57.903+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:58.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:58.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:58.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:58.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:59.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:32:59.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:32:59.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:32:59.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:00.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:00.097+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:00.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:00.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:01.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:01.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:02.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:02.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:02.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:02.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:02.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:02.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:03.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:03.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:04.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:04.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:04.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:04.065+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:05.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:05.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:05.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:05.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:05.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:05.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:06.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:06.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:07.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:07.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:07.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:07.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:07.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:07.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:08.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:08.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:09.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:09.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:09.074 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:09.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:09.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:09.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:10.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:10.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:10.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:10.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:11.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:11.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:11.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:11.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:12.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:12.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:12.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:12.953+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:13.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:13.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:13.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:13.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:14.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:14.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:14.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:14.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:15.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:15.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:15.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:15.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:16.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:16.006+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:16.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:16.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:17.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:17.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:17.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:17.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:17.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:17.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:18.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:18.980+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:19.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:19.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:20.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:20.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:20.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:20.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:21.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:21.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:21.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:21.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:22.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:22.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:22.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:22.056+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:23.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:23.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:23.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:23.074+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:24.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:24.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:24.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:24.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:25.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:25.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:25.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:25.100+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:26.043 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:26.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:26.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:26.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:27.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:27.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:27.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:27.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:28.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:28.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:28.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:28.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:29.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:29.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:29.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:29.148+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:30.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:30.125+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:30.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:30.194+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:31.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:31.107+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:31.240 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:31.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:32.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:32.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:32.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:32.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:33.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:33.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:33.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:33.239+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:34.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:34.044+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:34.289 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:34.289+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:35.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:35.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:35.260 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:35.260+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:36.066 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:36.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:36.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:36.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:37.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:37.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:37.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:37.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:38.066 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:38.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:38.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:38.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:39.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:39.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:39.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:39.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:40.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:40.032+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:40.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:40.301+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:41.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:41.005+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:41.274 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:41.274+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:41.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:41.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:42.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:42.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:42.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:42.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:43.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:43.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:43.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:43.896+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:44.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:44.290+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:44.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:44.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:45.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:45.339+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:45.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:45.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:46.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:46.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:46.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:46.904+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:47.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:47.310+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:47.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:47.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:48.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:48.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:48.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:48.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:49.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:49.250+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:49.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:49.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:50.263 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:50.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:50.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:50.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:51.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:51.232+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:51.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:51.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:52.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:52.218+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:52.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:52.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:53.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:53.243+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:53.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:53.826+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:54.202 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:54.202+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:54.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:54.784+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:55.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:55.214+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:55.781 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:55.781+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:56.229 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:56.229+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:56.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:56.762+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:57.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:57.250+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:57.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:57.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:58.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:58.251+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:58.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:58.797+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:59.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:33:59.236+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:33:59.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:33:59.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:00.201 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:00.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:00.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:00.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:01.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:01.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:01.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:01.763+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:02.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:02.252+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:02.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:02.721+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:03.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:03.232+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:03.758 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:03.759+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:04.229 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:04.229+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:04.733 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:04.732+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:05.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:05.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:05.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:05.764+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:06.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:06.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:06.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:06.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:07.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:07.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:07.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:07.772+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:08.267 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:08.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:08.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:08.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:09.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:09.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:09.735 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:09.736+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:10.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:10.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:10.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:10.696+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:11.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:11.282+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:11.673 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:11.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:12.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:12.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:12.711 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:12.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:13.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:13.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:13.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:13.699+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:14.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:14.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:14.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:14.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:15.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:15.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:15.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:15.695+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:16.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:16.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:16.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:16.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:17.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:17.434+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:17.677 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:17.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:18.425 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:18.425+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:18.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:18.714+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:19.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:19.424+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:19.757 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:19.756+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:20.474 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:20.474+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:20.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:20.753+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:21.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:21.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:21.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:21.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:22.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:22.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:22.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:22.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:23.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:23.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:23.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:23.773+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:24.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:24.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:24.778 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:24.778+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:25.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:25.417+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:25.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:25.776+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:26.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:26.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:26.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:26.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:27.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:27.450+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:27.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:27.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:28.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:28.440+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:28.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:28.786+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:29.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:29.417+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:29.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:29.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:30.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:30.415+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:30.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:30.819+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:31.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:31.383+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:31.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:31.863+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:32.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:32.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:32.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:32.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:33.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:33.374+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:33.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:33.829+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:34.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:34.372+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:34.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:34.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:35.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:35.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:35.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:35.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:36.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:36.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:36.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:36.797+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:37.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:37.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:37.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:37.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:38.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:38.265+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:38.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:38.867+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:39.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:39.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:39.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:39.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:40.227 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:40.227+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:40.795 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:40.795+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:41.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:41.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:41.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:41.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:42.157 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:42.156+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:42.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:42.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:43.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:43.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:43.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:43.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:44.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:44.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:44.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:44.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:45.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:45.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:45.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:45.717+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:46.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:46.168+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:46.719 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:46.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:47.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:47.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:47.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:47.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:48.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:48.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:48.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:48.731+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:49.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:49.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:49.707 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:49.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:50.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:50.226+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:50.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:50.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:51.240 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:51.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:51.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:51.760+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:52.267 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:52.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:52.744 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:52.745+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:53.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:53.282+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:53.725 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:53.726+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:54.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:54.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:54.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:54.723+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:55.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:55.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:55.739 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:55.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:56.292 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:56.293+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:56.743 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:56.744+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:57.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:57.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:57.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:57.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:58.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:58.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:58.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:58.784+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:59.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:34:59.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:34:59.793 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:34:59.793+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:00.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:00.339+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:00.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:00.769+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:01.319 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:01.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:01.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:01.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:02.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:02.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:02.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:02.709+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:03.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:03.322+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:03.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:03.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:04.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:04.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:04.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:04.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:05.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:05.326+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:05.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:05.622+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:06.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:06.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:06.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:06.591+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:07.350 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:07.350+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:07.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:07.624+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:08.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:08.303+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:08.621 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:08.620+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:09.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:09.295+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:09.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:09.667+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:10.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:10.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:10.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:10.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:11.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:11.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:11.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:11.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:12.269 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:12.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:12.738 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:12.737+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:13.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:13.302+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:13.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:13.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:14.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:14.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:14.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:14.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:15.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:15.373+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:15.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:15.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:16.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:16.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:16.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:16.776+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:17.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:17.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:17.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:17.732+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:18.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:18.354+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:18.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:18.726+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:19.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:19.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:19.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:19.693+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:20.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:20.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:20.737 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:20.737+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:21.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:21.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:21.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:21.744+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:22.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:22.357+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:22.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:22.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:23.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:23.369+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:23.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:23.692+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:24.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:24.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:24.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:24.715+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:25.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:25.399+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:25.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:25.712+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:26.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:26.384+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:26.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:26.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:27.405 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:27.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:27.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:27.720+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:28.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:28.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:28.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:28.762+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:29.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:29.468+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:29.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:29.776+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:30.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:30.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:30.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:30.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:31.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:31.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:31.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:31.772+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:32.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:32.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:32.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:32.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:33.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:33.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:33.814 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:33.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:34.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:34.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:34.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:34.768+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:35.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:35.594+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:35.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:35.771+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:36.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:36.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:36.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:36.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:37.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:37.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:37.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:37.773+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:38.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:38.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:38.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:38.822+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:39.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:39.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:39.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:39.791+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:40.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:40.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:40.793 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:40.793+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:41.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:41.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:41.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:41.840+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:42.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:42.563+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:42.856 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:42.855+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:43.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:43.531+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:43.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:43.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:44.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:44.540+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:44.889 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:44.888+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:45.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:45.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:45.881 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:45.880+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:46.537 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:46.536+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:46.904 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:46.904+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:47.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:47.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:47.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:47.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:48.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:48.487+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:48.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:48.890+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:49.500 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:49.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:49.908 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:49.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:50.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:50.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:50.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:50.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:51.555 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:51.555+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:51.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:51.905+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:52.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:52.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:52.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:52.871+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:53.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:53.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:53.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:53.863+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:54.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:54.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:54.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:54.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:55.555 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:55.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:55.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:55.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:56.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:56.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:56.857 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:56.857+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:57.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:57.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:57.845 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:57.845+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:58.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:58.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:58.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:58.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:59.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:35:59.483+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:35:59.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:35:59.812+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:00.469 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:00.469+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:00.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:00.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:01.472 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:01.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:01.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:01.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:02.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:02.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:02.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:02.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:03.493 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:03.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:03.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:03.834+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:04.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:04.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:04.811 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:04.811+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:05.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:05.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:05.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:05.787+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:06.486 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:06.486+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:06.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:06.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:07.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:07.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:07.769 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:07.769+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:08.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:08.498+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:08.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:08.767+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:09.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:09.450+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:09.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:09.779+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:10.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:10.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:10.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:10.786+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:11.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:11.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:11.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:11.818+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:12.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:12.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:12.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:12.829+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:13.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:13.426+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:13.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:13.877+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:14.407 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:14.406+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:14.854 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:14.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:15.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:15.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:15.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:15.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:16.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:16.411+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:16.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:16.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:17.410 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:17.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:17.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:17.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:18.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:18.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:18.908 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:18.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:19.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:19.469+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:19.927 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:19.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:20.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:20.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:20.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:20.892+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:21.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:21.435+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:21.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:21.897+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:22.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:22.410+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:22.939 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:22.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:23.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:23.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:23.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:23.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:24.488 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:24.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:24.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:24.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:25.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:25.464+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:25.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:25.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:26.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:26.477+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:26.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:26.934+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:27.447 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:27.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:27.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:27.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:28.438 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:28.437+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:29.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:29.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:29.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:29.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:29.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:29.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:30.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:30.441+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:31.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:31.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:31.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:31.408+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:32.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:32.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:32.391 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:32.391+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:33.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:33.031+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:33.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:33.385+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:34.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:34.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:34.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:34.365+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:35.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:35.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:35.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:35.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:36.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:36.032+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:36.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:36.354+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:37.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:37.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:37.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:37.384+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:38.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:38.059+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:38.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:38.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:39.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:39.099+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:39.415 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:39.415+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:40.121 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:40.121+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:40.414 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T15:36:40.413+0000 7fcd7f3d4700 0 -- 172.21.15.69:0/2655470317 >> [v2:172.21.15.69:6816/86628,v1:172.21.15.69:6817/86628] conn(0x7fcd64034140 msgr2=0x7fcd64046a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T15:36:40.438 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:40.438+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:41.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:41.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:41.405 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:41.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:42.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:42.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:42.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:42.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:43.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:43.106+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:43.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:43.346+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:44.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:44.088+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:44.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:44.356+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:45.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:45.093+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:45.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:45.380+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:46.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:46.107+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:46.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:46.413+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:47.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:47.101+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:47.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:47.417+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:48.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:48.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:48.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:48.388+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:49.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:49.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:49.373 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:49.373+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:50.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:50.160+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:50.370 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:50.370+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:51.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:51.184+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:51.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:51.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:52.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:52.221+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:52.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:52.356+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:53.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:53.257+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:53.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:53.363+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:54.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:54.257+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:54.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:54.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:55.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:55.287+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:55.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:55.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:56.242 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:56.242+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:56.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:56.400+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:57.207 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:57.207+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:57.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:57.427+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:58.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:58.161+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:58.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:58.392+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:59.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:36:59.124+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:36:59.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:36:59.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:00.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:00.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:00.416 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:00.415+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:01.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:01.182+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:01.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:01.441+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:02.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:02.175+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:02.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:02.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:03.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:03.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:03.465 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:03.465+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:04.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:04.180+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:04.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:04.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:05.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:05.182+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:05.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:05.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:06.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:06.160+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:06.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:06.463+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:07.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:07.176+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:07.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:07.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:08.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:08.142+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:08.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:08.447+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:09.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:09.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:09.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:09.452+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:10.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:10.200+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:10.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:10.461+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:11.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:11.228+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:11.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:11.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:12.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:12.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:12.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:12.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:13.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:13.285+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:13.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:13.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:14.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:14.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:14.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:14.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:15.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:15.334+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:15.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:15.593+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:16.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:16.345+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:16.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:16.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:17.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:17.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:17.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:17.638+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:18.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:18.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:18.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:18.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:19.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:19.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:19.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:19.624+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:20.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:20.462+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:20.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:20.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:21.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:21.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:21.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:21.600+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:22.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:22.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:22.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:22.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:23.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:23.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:23.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:23.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:24.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:24.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:24.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:24.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:25.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:25.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:25.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:25.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:26.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:26.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:26.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:26.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:27.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:27.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:27.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:27.590+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:28.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:28.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:28.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:28.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:29.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:29.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:29.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:29.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:30.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:30.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:30.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:30.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:31.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:31.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:31.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:31.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:32.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:32.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:32.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:32.569+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:33.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:33.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:33.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:33.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:34.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:34.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:34.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:34.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:35.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:35.461+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:35.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:35.676+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:36.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:36.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:36.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:36.716+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:37.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:37.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:37.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:37.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:38.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:38.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:38.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:38.697+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:39.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:39.587+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:39.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:39.726+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:40.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:40.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:40.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:40.726+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:41.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:41.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:41.716 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:41.715+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:42.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:42.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:42.698 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:42.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:43.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:43.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:43.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:43.717+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:44.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:44.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:44.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:44.756+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:45.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:45.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:45.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:45.797+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:46.635 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:46.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:46.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:46.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:47.615 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:47.615+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:47.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:47.770+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:48.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:48.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:48.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:48.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:49.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:49.680+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:49.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:49.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:50.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:50.658+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:50.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:50.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:51.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:51.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:51.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:51.806+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:52.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:52.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:52.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:52.793+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:53.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:53.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:53.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:53.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:54.651 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:54.652+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:54.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:54.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:55.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:55.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:55.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:55.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:56.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:56.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:56.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:56.806+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:57.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:57.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:57.757 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:57.757+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:58.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:58.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:58.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:58.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:59.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:37:59.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:37:59.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:37:59.755+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:00.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:00.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:00.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:00.716+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:01.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:01.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:01.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:01.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:02.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:02.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:02.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:02.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:03.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:03.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:03.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:03.758+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:04.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:04.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:04.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:04.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:05.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:05.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:05.701 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:05.701+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:06.490 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:06.490+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:06.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:06.686+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:07.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:07.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:07.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:07.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:08.486 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:08.485+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:08.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:08.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:09.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:09.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:09.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:09.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:10.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:10.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:10.653 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:10.653+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:11.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:11.424+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:11.696 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:11.696+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:12.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:12.433+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:12.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:12.736+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:13.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:13.399+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:13.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:13.744+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:14.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:14.444+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:14.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:14.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:15.466 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:15.466+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:15.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:15.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:16.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:16.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:16.729 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:16.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:17.485 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:17.484+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:17.758 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:17.758+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:18.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:18.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:18.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:18.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:19.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:19.515+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:19.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:19.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:20.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:20.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:20.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:20.830+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:21.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:21.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:21.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:21.812+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:22.511 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:22.511+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:22.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:22.784+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:23.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:23.462+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:23.775 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:23.775+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:24.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:24.419+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:24.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:24.791+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:25.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:25.380+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:25.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:25.834+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:26.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:26.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:26.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:26.843+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:27.430 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:27.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:27.810 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:27.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:28.479 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:28.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:28.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:28.844+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:29.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:29.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:29.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:29.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:30.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:30.444+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:30.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:30.851+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:31.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:31.452+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:31.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:31.805+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:32.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:32.461+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:32.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:32.842+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:33.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:33.419+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:33.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:33.851+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:34.445 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:34.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:34.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:34.873+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:35.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:35.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:35.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:35.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:36.406 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:36.407+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:36.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:36.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:37.405 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:37.406+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:37.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:37.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:38.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:38.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:38.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:38.896+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:39.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:39.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:39.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:39.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:40.414 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:40.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:40.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:40.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:41.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:41.385+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:41.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:41.879+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:42.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:42.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:42.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:42.867+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:43.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:43.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:43.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:43.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:44.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:44.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:44.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:44.917+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:45.352 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:45.352+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:45.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:45.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:46.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:46.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:46.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:46.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:47.389 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:47.389+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:47.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:47.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:48.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:48.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:48.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:48.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:49.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:49.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:49.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:49.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:50.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:50.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:50.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:50.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:51.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:51.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:51.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:51.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:52.323 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:52.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:52.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:52.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:53.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:53.303+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:53.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:53.916+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:54.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:54.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:54.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:54.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:55.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:55.288+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:55.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:55.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:56.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:56.243+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:56.872 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:56.838+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:57.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:57.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:57.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:57.806+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:58.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:58.241+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:58.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:58.800+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:59.223 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:38:59.223+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:38:59.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:38:59.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:00.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:00.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:00.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:00.841+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:01.269 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:01.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:01.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:01.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:02.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:02.233+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:02.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:02.815+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:03.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:03.203+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:03.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:03.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:04.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:04.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:04.860 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:04.859+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:05.190 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:05.189+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:05.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:05.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:06.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:06.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:06.851 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:06.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:07.268 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:07.268+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:07.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:07.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:08.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:08.241+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:08.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:08.891+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:09.251 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:09.251+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:09.863 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:09.863+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:10.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:10.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:10.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:10.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:11.295 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:11.295+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:11.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:11.837+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:12.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:12.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:12.849 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:12.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:13.375 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:13.375+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:13.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:13.853+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:14.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:14.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:14.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:14.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:15.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:15.296+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:15.779 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:15.779+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:16.301 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:16.300+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:16.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:16.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:17.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:17.255+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:17.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:17.727+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:18.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:18.302+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:18.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:18.720+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:19.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:19.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:19.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:19.732+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:20.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:20.334+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:20.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:20.770+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:21.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:21.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:21.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:21.772+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:22.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:22.388+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:22.820 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:22.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:23.367 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:23.368+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:23.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:23.837+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:24.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:24.401+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:24.846 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:24.847+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:25.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:25.380+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:25.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:25.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:26.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:26.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:26.776 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:26.776+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:27.383 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:27.383+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:27.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:27.764+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:28.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:28.348+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:28.733 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:28.733+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:29.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:29.334+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:29.724 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:29.725+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:30.291 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:30.291+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:30.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:30.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:31.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:31.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:31.743 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:31.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:32.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:32.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:32.716 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:32.715+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:33.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:33.312+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:33.755 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:33.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:34.269 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:34.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:34.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:34.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:35.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:35.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:35.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:35.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:36.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:36.278+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:36.767 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:36.767+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:37.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:37.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:37.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:37.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:38.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:38.327+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:38.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:38.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:39.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:39.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:39.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:39.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:40.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:40.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:40.633 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:40.633+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:41.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:41.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:41.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:41.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:42.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:42.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:42.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:42.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:43.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:43.226+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:43.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:43.637+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:44.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:44.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:44.666 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:44.666+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:45.253 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:45.252+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:45.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:45.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:46.236 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:46.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:46.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:46.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:47.229 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:47.229+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:47.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:47.717+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:48.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:48.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:48.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:48.715+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:49.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:49.210+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:49.705 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:49.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:50.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:50.254+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:50.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:50.663+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:51.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:51.296+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:51.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:51.710+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:52.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:52.252+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:52.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:52.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:53.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:53.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:53.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:53.670+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:54.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:54.296+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:54.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:54.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:55.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:55.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:55.623 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:55.623+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:56.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:56.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:56.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:56.626+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:57.316 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:57.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:57.662 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:57.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:58.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:58.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:58.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:58.692+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:59.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:39:59.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:39:59.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:39:59.656+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:00.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:00.326+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:00.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:00.622+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:01.362 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:01.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:01.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:01.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:02.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:02.327+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:02.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:02.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:03.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:03.278+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:03.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:03.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:04.230 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:04.230+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:04.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:04.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:05.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:05.275+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:05.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:05.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:06.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:06.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:06.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:06.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:07.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:07.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:07.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:07.614+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:08.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:08.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:08.579 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:08.580+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:09.282 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:09.282+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:09.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:09.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:10.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:10.280+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:10.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:10.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:11.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:11.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:11.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:11.602+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:12.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:12.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:12.602 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:12.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:13.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:13.245+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:13.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:13.574+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:14.254 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:14.254+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:14.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:14.530+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:15.208 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:15.208+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:15.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:15.518+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:16.186 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:16.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:16.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:16.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:17.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:17.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:17.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:17.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:18.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:18.177+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:18.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:18.595+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:19.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:19.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:19.591 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:19.591+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:20.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:20.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:20.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:20.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:21.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:21.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:21.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:21.607+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:22.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:22.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:22.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:22.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:23.115 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:23.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:23.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:23.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:24.145 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:24.144+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:24.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:24.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:25.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:25.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:25.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:25.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:26.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:26.142+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:26.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:26.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:27.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:27.170+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:27.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:27.609+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:28.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:28.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:28.649 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:28.648+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:29.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:29.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:29.676 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:29.675+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:30.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:30.178+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:30.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:30.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:31.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:31.148+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:31.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:31.601+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:32.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:32.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:32.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:32.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:33.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:33.158+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:33.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:33.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:34.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:34.113+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:34.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:34.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:35.164 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:35.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:35.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:35.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:36.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:36.158+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:36.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:36.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:37.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:37.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:37.568 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:37.568+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:38.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:38.225+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:38.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:38.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:39.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:39.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:39.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:39.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:40.231 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:40.230+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:40.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:40.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:41.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:41.218+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:41.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:41.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:42.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:42.181+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:42.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:42.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:43.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:43.184+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:43.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:43.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:44.213 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:44.213+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:44.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:44.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:45.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:45.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:45.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:45.566+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:46.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:46.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:46.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:46.541+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:47.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:47.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:47.591 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:47.590+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:48.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:48.233+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:48.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:48.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:49.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:49.191+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:49.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:49.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:50.201 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:50.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:50.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:50.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:51.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:51.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:51.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:51.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:52.186 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:52.186+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:52.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:52.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:53.179 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:53.180+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:53.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:53.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:54.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:54.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:54.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:54.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:55.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:55.181+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:55.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:55.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:56.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:56.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:56.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:56.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:57.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:57.204+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:57.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:57.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:58.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:58.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:58.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:58.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:59.186 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:40:59.186+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:40:59.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:40:59.427+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:00.178 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:00.178+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:00.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:00.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:01.183 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:01.183+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:01.449 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:01.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:02.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:02.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:02.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:02.473+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:03.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:03.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:03.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:03.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:04.181 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:04.180+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:04.528 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:04.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:05.223 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:05.222+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:05.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:05.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:06.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:06.240+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:06.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:06.531+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:07.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:07.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:07.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:07.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:08.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:08.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:08.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:08.580+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:09.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:09.327+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:09.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:09.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:10.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:10.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:10.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:10.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:11.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:11.394+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:11.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:11.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:12.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:12.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:12.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:12.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:13.387 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:13.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:13.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:13.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:14.399 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:14.399+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:14.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:14.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:15.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:15.400+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:15.478 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:15.477+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:16.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:16.380+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:16.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:16.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:17.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:17.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:17.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:17.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:18.358 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:18.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:18.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:18.561+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:19.382 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:19.381+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:19.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:19.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:20.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:20.397+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:20.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:20.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:21.354 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:21.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:21.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:21.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:22.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:22.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:22.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:22.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:23.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:23.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:23.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:23.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:24.327 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:24.326+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:24.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:24.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:25.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:25.360+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:25.525 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:25.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:26.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:26.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:26.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:26.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:27.404 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:27.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:27.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:27.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:28.375 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:28.375+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:28.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:28.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:29.417 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:29.417+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:29.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:29.561+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:30.452 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:30.451+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:30.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:30.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:31.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:31.422+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:31.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:31.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:32.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:32.420+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:32.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:32.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:33.402 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:33.401+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:33.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:33.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:34.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:34.356+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:34.525 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:34.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:35.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:35.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:35.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:35.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:36.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:36.348+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:36.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:36.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:37.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:37.372+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:37.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:37.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:38.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:38.339+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:38.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:38.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:39.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:39.389+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:39.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:39.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:40.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:40.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:40.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:40.462+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:41.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:41.449+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:41.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:41.487+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:42.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:42.401+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:42.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:42.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:43.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:43.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:43.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:43.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:44.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:44.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:44.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:44.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:45.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:45.348+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:45.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:45.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:46.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:46.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:46.477 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:46.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:47.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:47.326+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:47.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:47.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:48.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:48.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:48.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:48.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:49.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:49.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:49.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:49.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:50.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:50.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:50.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:50.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:51.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:51.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:51.566 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:51.565+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:52.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:52.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:52.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:52.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:53.398 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:53.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:53.633 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:53.633+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:54.364 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:54.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:54.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:54.601+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:55.384 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:55.383+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:55.566 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:55.565+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:56.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:56.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:56.590 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:56.589+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:57.435 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:57.435+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:57.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:57.607+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:58.437 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:58.436+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:58.620 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:58.619+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:59.471 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:41:59.470+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:41:59.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:41:59.616+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:00.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:00.506+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:00.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:00.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:01.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:01.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:01.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:01.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:02.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:02.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:02.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:02.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:03.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:03.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:03.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:03.627+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:04.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:04.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:04.601 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:04.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:05.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:05.505+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:05.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:05.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:06.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:06.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:06.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:06.668+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:07.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:07.506+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:07.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:07.666+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:08.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:08.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:08.652 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:08.652+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:09.544 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:09.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:09.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:09.619+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:10.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:10.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:10.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:10.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:11.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:11.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:11.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:11.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:12.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:12.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:12.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:12.541+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:13.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:13.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:13.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:13.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:14.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:14.531+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:14.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:14.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:15.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:15.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:15.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:15.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:16.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:16.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:16.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:16.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:17.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:17.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:17.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:17.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:18.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:18.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:18.504 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:18.504+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:19.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:19.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:19.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:19.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:20.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:20.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:20.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:20.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:21.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:21.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:21.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:21.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:22.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:22.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:22.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:22.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:23.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:23.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:23.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:23.584+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:24.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:24.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:24.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:24.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:25.424 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:25.424+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:25.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:25.588+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:26.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:26.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:26.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:26.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:27.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:27.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:27.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:27.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:28.456 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:28.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:28.521 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:28.522+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:29.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:29.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:29.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:29.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:30.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:30.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:30.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:30.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:31.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:31.489+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:31.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:31.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:32.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:32.505+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:32.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:32.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:33.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:33.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:33.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:33.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:34.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:34.466+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:34.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:34.600+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:35.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:35.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:35.616 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:35.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:36.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:36.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:36.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:36.662+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:37.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:37.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:37.644 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:37.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:38.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:38.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:38.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:38.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:39.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:39.518+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:39.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:39.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:40.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:40.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:40.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:40.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:41.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:41.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:41.669 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:41.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:42.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:42.584+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:42.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:42.690+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:43.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:43.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:43.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:43.735+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:44.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:44.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:44.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:44.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:45.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:45.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:45.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:45.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:46.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:46.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:46.812 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:46.812+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:47.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:47.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:47.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:47.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:48.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:48.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:48.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:48.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:49.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:49.529+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:49.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:49.811+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:50.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:50.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:50.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:50.803+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:51.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:51.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:51.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:51.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:52.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:52.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:52.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:52.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:53.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:53.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:53.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:53.805+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:54.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:54.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:54.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:54.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:55.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:55.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:55.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:55.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:56.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:56.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:56.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:56.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:57.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:57.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:57.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:57.862+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:58.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:58.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:58.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:58.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:59.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:42:59.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:42:59.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:42:59.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:00.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:00.584+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:00.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:00.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:01.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:01.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:01.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:01.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:02.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:02.589+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:02.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:02.922+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:03.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:03.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:03.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:03.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:04.607 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:04.606+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:04.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:04.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:05.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:05.580+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:05.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:05.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:06.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:06.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:06.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:06.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:07.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:07.586+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:07.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:07.917+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:08.636 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:08.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:08.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:08.873+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:09.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:09.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:09.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:09.830+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:10.633 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:10.634+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:10.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:10.854+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:11.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:11.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:11.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:11.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:12.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:12.675+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:12.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:12.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:13.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:13.702+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:13.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:13.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:14.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:14.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:14.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:14.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:15.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:15.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:15.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:15.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:16.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:16.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:16.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:16.950+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:17.722 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:17.722+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:17.983 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:17.984+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:18.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:18.716+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:19.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:19.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:19.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:19.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:20.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:20.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:20.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:20.719+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:21.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:21.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:21.707 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:21.707+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:22.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:22.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:22.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:22.675+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:23.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:23.069+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:23.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:23.680+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:24.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:24.116+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:24.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:24.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:25.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:25.124+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:25.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:25.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:26.121 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:26.120+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:26.625 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:26.625+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:27.159 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:27.158+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:27.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:27.640+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:28.152 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:28.151+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:28.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:28.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:29.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:29.189+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:29.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:29.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:30.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:30.215+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:30.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:30.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:31.175 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:31.174+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:31.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:31.584+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:32.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:32.224+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:32.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:32.627+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:33.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:33.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:33.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:33.663+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:34.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:34.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:34.662 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:34.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:35.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:35.176+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:35.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:35.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:36.170 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:36.170+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:36.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:36.592+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:37.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:37.208+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:37.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:37.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:38.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:38.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:38.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:38.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:39.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:39.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:39.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:39.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:40.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:40.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:40.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:40.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:41.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:41.191+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:41.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:41.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:42.177 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:42.177+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:42.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:42.541+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:43.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:43.192+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:43.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:43.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:44.191 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:44.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:44.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:44.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:45.195 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:45.195+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:45.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:45.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:46.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:46.160+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:46.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:46.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:47.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:47.117+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:47.593 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:47.593+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:48.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:48.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:48.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:48.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:49.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:49.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:49.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:49.568+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:50.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:50.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:50.528 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:50.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:51.100 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:51.099+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:51.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:51.493+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:52.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:52.083+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:52.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:52.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:53.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:53.077+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:53.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:53.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:54.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:54.124+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:54.404 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:54.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:55.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:55.157+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:55.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:55.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:56.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:56.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:56.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:56.378+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:57.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:57.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:57.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:57.347+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:58.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:58.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:58.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:58.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:59.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:43:59.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:43:59.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:43:59.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:00.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:00.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:00.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:00.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:01.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:01.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:01.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:01.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:01.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:01.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:02.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:02.383+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:02.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:02.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:03.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:03.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:03.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:03.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:04.427 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:04.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:04.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:04.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:05.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:05.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:06.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:06.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:06.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:06.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:07.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:07.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:07.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:07.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:08.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:08.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:08.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:08.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:09.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:09.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:09.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:09.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:10.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:10.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:10.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:10.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:11.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:11.102+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:11.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:11.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:12.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:12.129+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:12.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:12.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:13.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:13.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:13.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:13.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:14.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:14.074+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:14.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:14.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:15.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:15.083+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:15.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:15.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:16.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:16.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:16.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:16.490+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:17.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:17.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:17.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:17.487+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:18.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:18.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:18.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:18.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:19.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:19.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:19.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:19.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:20.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:20.020+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:20.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:20.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:21.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:21.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:21.447 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:21.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:22.021 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:22.020+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:22.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:22.412+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:23.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:23.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:23.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:23.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:24.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:24.091+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:24.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:24.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:25.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:25.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:25.381 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:25.380+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:26.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:26.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:26.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:26.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:27.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:27.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:27.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:27.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:28.202 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:28.202+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:28.389 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:28.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:29.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:29.237+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:29.356 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:29.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:30.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:30.225+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:30.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:30.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:31.260 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:31.260+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:31.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:31.335+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:32.230 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:32.230+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:32.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:32.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:33.182 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:33.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:33.349 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:33.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:34.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:34.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:34.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:34.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:35.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:35.194+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:35.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:35.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:36.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:36.183+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:36.361 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:36.360+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:37.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:37.175+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:37.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:37.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:38.202 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:38.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:38.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:38.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:39.202 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:39.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:39.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:39.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:40.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:40.241+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:40.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:40.281+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:41.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:41.255+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:41.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:41.271+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:42.272 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:42.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:42.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:42.285+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:43.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:43.267+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:43.276 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:43.277+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:44.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:44.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:44.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:44.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:45.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:45.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:45.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:45.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:46.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:46.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:46.323 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:46.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:47.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:47.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:47.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:47.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:48.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:48.257+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:48.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:48.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:49.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:49.241+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:49.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:49.335+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:50.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:50.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:50.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:50.296+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:51.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:51.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:51.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:51.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:52.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:52.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:52.368 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:52.367+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:53.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:53.161+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:53.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:53.356+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:54.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:54.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:54.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:54.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:55.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:55.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:55.396 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:55.396+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:56.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:56.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:56.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:56.427+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:57.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:57.142+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:57.424 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:57.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:58.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:58.181+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:58.379 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:58.379+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:59.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:44:59.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:44:59.426 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:44:59.425+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:00.168 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:00.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:00.418 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:00.418+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:01.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:01.187+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:01.434 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:01.434+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:02.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:02.165+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:02.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:02.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:03.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:03.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:03.367 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:03.367+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:04.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:04.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:04.414 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:04.413+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:05.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:05.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:05.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:05.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:06.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:06.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:06.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:06.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:07.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:07.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:07.315 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:07.315+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:08.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:08.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:08.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:08.313+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:09.186 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:09.185+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:09.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:09.329+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:10.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:10.174+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:10.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:10.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:11.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:11.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:11.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:11.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:12.095 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:12.093+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:12.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:12.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:13.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:13.099+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:13.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:13.421+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:14.087 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:14.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:14.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:14.419+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:15.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:15.125+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:15.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:15.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:16.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:16.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:16.433 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:16.433+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:17.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:17.122+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:17.405 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:17.404+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:18.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:18.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:18.413 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:18.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:19.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:19.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:19.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:19.455+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:20.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:20.140+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:20.451 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:20.451+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:21.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:21.124+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:21.475 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:21.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:22.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:22.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:22.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:22.506+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:23.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:23.129+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:23.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:23.507+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:24.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:24.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:24.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:24.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:25.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:25.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:25.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:25.515+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:26.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:26.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:26.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:26.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:27.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:27.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:27.501 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:27.501+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:28.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:28.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:28.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:28.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:29.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:29.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:29.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:29.482+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:30.226 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:30.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:30.479 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:30.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:31.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:31.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:31.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:31.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:32.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:32.270+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:32.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:32.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:33.226 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:33.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:33.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:33.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:34.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:34.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:34.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:34.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:35.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:35.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:35.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:35.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:36.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:36.253+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:36.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:36.571+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:37.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:37.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:37.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:37.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:38.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:38.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:38.559 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:38.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:39.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:39.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:39.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:39.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:40.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:40.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:40.651 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:40.650+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:41.174 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:41.173+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:41.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:41.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:42.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:42.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:42.660 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:42.660+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:43.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:43.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:43.628 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:43.627+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:44.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:44.210+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:44.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:44.590+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:45.186 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:45.185+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:45.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:45.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:46.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:46.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:46.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:46.514+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:47.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:47.108+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:47.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:47.467+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:48.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:48.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:48.436 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:48.435+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:49.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:49.106+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:49.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:49.411+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:50.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:50.062+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:50.453 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:50.453+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:51.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:51.111+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:51.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:51.440+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:52.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:52.081+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:52.409 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:52.409+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:53.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:53.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:53.372 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:53.372+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:54.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:54.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:54.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:54.327+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:55.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:55.069+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:55.317 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:55.317+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:56.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:56.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:56.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:56.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:56.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:56.995+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:57.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:57.317+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:58.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:58.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:58.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:58.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:58.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:58.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:59.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:45:59.320+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:45:59.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:45:59.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:00.335 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:00.335+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:00.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:00.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:01.358 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:01.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:01.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:01.923+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:02.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:02.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:02.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:02.887+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:03.393 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:03.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:03.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:03.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:04.378 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:04.378+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:04.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:04.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:05.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:05.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:05.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:05.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:06.388 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:06.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:06.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:06.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:07.366 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:07.366+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:07.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:07.916+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:08.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:08.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:08.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:08.939+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:09.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:09.394+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:09.895 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:09.895+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:10.414 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:10.414+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:10.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:10.899+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:11.431 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:11.430+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:11.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:11.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:12.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:12.439+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:12.990 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:12.990+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:13.475 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:13.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:13.972 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:13.972+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:14.523 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:14.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:14.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:14.992+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:15.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:15.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:16.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:16.025+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:16.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:16.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:17.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:17.052+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:17.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:17.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:18.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:18.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:18.611 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:18.611+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:18.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:18.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:19.658 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:19.658+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:19.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:19.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:20.695 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:20.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:21.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:21.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:21.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:21.649+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:21.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:21.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:22.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:22.624+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:22.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:22.972+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:23.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:23.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:23.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:23.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:24.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:24.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:24.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:24.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:25.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:25.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:25.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:25.917+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:26.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:26.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:26.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:26.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:27.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:27.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:27.859 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:27.858+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:28.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:28.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:28.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:28.834+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:29.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:29.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:29.804 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:29.803+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:30.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:30.625+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:30.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:30.849+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:31.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:31.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:31.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:31.815+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:32.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:32.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:32.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:32.787+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:33.561 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:33.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:33.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:33.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:34.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:34.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:34.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:34.760+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:35.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:35.543+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:35.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:35.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:36.526 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:36.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:36.723 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:36.722+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:37.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:37.514+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:37.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:37.755+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:38.479 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:38.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:38.781 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:38.780+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:39.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:39.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:39.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:39.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:40.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:40.492+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:40.718 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:40.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:41.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:41.504+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:41.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:41.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:42.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:42.508+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:42.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:42.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:43.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:43.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:43.742 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:43.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:44.522 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:44.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:44.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:44.700+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:45.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:45.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:45.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:45.709+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:46.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:46.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:46.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:46.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:47.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:47.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:47.748 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:47.747+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:48.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:48.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:48.765 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:48.765+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:49.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:49.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:49.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:49.813+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:50.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:50.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:50.810 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:50.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:51.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:51.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:51.858 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:51.858+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:52.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:52.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:52.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:52.832+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:53.653 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:53.653+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:53.867 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:53.867+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:54.616 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:54.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:54.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:54.853+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:55.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:55.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:55.827 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:55.827+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:56.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:56.637+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:56.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:56.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:57.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:57.648+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:57.858 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:57.858+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:58.683 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:58.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:58.843 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:58.843+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:59.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:46:59.704+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:46:59.885 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:46:59.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:00.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:00.672+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:00.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:00.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:01.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:01.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:01.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:01.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:02.665 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:02.666+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:02.887 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:02.888+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:03.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:03.633+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:03.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:03.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:04.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:04.654+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:04.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:04.884+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:05.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:05.613+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:05.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:05.893+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:06.659 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:06.659+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:06.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:06.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:07.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:07.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:07.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:07.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:08.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:08.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:08.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:08.934+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:09.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:09.704+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:09.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:09.925+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:10.699 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:10.698+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:10.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:10.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:11.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:11.700+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:11.894 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:11.894+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:12.669 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:12.668+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:12.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:12.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:13.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:13.705+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:13.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:13.865+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:14.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:14.735+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:14.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:14.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:15.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:15.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:15.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:15.911+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:16.699 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:16.698+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:16.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:16.879+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:17.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:17.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:17.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:17.832+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:18.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:18.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:18.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:18.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:19.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:19.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:19.873 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:19.872+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:20.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:20.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:20.833 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:20.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:21.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:21.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:21.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:21.853+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:22.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:22.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:22.841 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:22.840+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:23.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:23.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:23.793 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:23.793+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:24.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:24.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:24.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:24.829+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:25.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:25.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:25.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:25.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:26.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:26.759+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:26.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:26.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:27.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:27.731+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:27.790 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:27.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:28.765 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:28.765+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:28.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:28.766+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:29.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:29.721+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:29.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:29.803+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:30.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:30.702+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:30.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:30.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:31.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:31.702+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:31.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:31.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:32.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:32.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:32.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:32.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:33.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:33.681+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:33.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:33.827+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:34.645 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:34.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:34.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:34.875+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:35.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:35.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:35.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:35.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:36.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:36.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:36.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:36.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:37.651 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:37.650+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:37.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:37.765+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:38.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:38.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:38.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:38.717+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:39.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:39.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:39.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:39.677+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:40.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:40.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:40.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:40.714+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:41.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:41.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:41.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:41.760+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:42.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:42.696+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:42.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:42.785+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:43.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:43.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:43.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:43.824+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:44.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:44.665+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:44.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:44.865+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:45.636 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:45.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:45.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:45.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:46.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:46.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:46.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:46.853+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:47.715 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:47.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:47.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:47.893+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:48.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:48.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:48.869 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:48.870+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:49.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:49.788+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:49.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:49.908+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:50.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:50.803+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:50.897 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:50.898+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:51.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:51.838+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:51.891 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:51.892+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:52.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:52.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:52.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:52.889+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:53.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:53.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:53.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:53.893+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:54.814 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:54.813+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:54.914 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:54.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:55.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:55.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:55.875 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:55.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:56.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:56.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:56.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:56.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:57.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:57.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:57.916 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:57.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:58.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:58.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:58.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:58.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:59.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:47:59.688+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:47:59.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:47:59.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:00.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:00.710+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:00.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:00.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:01.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:01.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:02.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:02.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:02.695 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:02.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:02.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:02.995+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:03.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:03.698+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:03.955 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:03.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:04.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:04.673+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:04.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:04.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:05.705 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:05.704+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:05.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:05.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:06.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:06.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:06.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:06.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:07.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:07.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:07.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:07.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:08.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:08.782+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:08.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:08.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:09.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:09.762+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:10.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:10.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:10.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:10.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:10.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:10.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:11.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:11.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:11.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:11.958+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:12.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:12.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:12.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:12.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:13.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:13.671+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:13.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:13.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:14.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:14.648+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:14.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:14.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:15.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:15.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:15.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:15.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:16.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:16.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:16.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:16.978+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:17.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:17.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:18.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:18.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:18.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:18.584+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:18.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:18.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:19.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:19.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:20.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:20.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:20.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:20.510+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:21.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:21.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:21.517 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:21.516+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:22.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:22.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:22.480 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:22.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:23.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:23.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:23.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:23.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:24.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:24.104+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:24.507 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:24.506+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:25.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:25.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:25.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:25.483+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:26.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:26.121+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:26.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:26.450+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:27.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:27.076+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:27.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:27.460+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:28.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:28.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:28.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:28.440+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:29.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:29.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:29.459 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:29.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:30.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:30.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:30.468 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:30.468+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:31.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:31.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:31.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:31.450+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:32.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:32.202+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:32.422 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:32.422+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:33.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:33.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:33.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:33.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:34.242 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:34.243+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:34.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:34.463+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:35.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:35.222+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:35.492 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:35.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:36.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:36.217+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:36.458 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:36.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:37.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:37.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:37.447 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:37.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:38.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:38.250+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:38.456 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:38.457+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:39.291 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:39.291+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:39.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:39.485+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:40.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:40.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:40.483 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:40.482+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:41.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:41.321+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:41.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:41.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:42.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:42.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:42.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:42.556+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:43.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:43.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:43.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:43.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:44.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:44.383+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:44.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:44.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:45.403 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:45.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:45.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:45.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:46.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:46.388+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:46.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:46.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:47.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:47.361+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:47.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:47.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:48.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:48.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:48.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:48.606+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:49.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:49.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:49.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:49.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:50.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:50.401+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:50.688 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:50.641+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:51.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:51.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:51.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:51.598+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:52.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:52.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:52.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:52.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:53.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:53.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:53.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:53.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:54.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:54.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:54.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:54.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:55.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:55.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:55.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:55.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:56.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:56.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:56.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:56.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:57.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:57.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:57.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:57.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:58.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:58.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:58.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:58.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:59.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:48:59.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:48:59.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:48:59.537+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:00.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:00.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:00.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:00.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:01.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:01.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:01.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:01.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:02.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:02.331+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:02.636 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:02.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:03.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:03.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:03.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:03.633+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:04.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:04.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:04.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:04.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:05.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:05.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:05.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:05.590+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:06.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:06.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:06.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:06.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:07.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:07.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:07.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:07.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:08.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:08.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:08.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:08.606+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:09.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:09.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:09.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:09.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:10.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:10.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:10.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:10.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:11.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:11.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:11.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:11.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:12.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:12.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:12.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:12.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:13.362 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:13.362+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:13.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:13.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:14.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:14.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:14.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:14.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:15.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:15.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:15.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:15.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:16.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:16.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:16.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:16.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:17.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:17.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:17.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:17.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:18.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:18.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:18.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:18.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:19.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:19.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:19.586 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:19.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:20.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:20.506+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:20.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:20.630+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:21.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:21.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:21.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:21.625+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:22.515 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:22.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:22.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:22.577+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:23.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:23.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:23.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:23.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:24.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:24.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:24.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:24.595+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:25.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:25.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:25.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:25.626+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:26.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:26.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:26.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:26.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:27.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:27.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:27.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:27.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:28.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:28.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:28.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:28.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:29.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:29.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:29.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:29.595+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:30.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:30.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:30.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:30.595+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:31.599 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:31.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:31.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:31.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:32.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:32.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:32.639 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:32.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:33.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:33.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:33.672 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:33.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:34.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:34.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:34.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:34.700+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:35.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:35.483+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:35.709 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:35.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:36.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:36.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:36.711 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:36.710+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:37.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:37.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:37.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:37.667+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:38.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:38.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:38.654 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:38.654+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:39.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:39.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:39.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:39.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:40.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:40.531+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:40.662 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:40.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:41.494 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:41.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:41.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:41.615+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:42.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:42.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:42.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:42.566+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:43.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:43.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:43.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:43.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:44.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:44.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:44.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:44.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:45.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:45.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:45.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:45.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:46.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:46.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:46.500 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:46.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:47.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:47.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:47.539 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:47.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:48.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:48.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:48.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:48.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:49.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:49.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:49.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:49.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:50.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:50.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:50.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:50.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:51.378 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:51.378+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:51.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:51.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:52.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:52.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:52.593 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:52.592+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:53.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:53.408+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:53.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:53.581+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:54.442 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:54.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:54.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:54.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:55.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:55.410+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:55.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:55.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:56.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:56.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:56.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:56.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:57.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:57.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:57.509 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:57.508+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:58.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:58.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:58.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:58.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:59.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:49:59.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:49:59.525 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:49:59.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:00.443 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:00.442+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:00.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:00.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:01.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:01.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:01.442 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:01.442+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:02.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:02.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:02.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:02.462+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:03.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:03.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:03.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:03.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:04.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:04.401+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:04.499 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:04.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:05.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:05.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:05.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:05.470+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:06.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:06.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:06.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:06.479+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:07.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:07.451+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:07.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:07.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:08.451 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:08.451+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:08.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:08.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:09.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:09.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:09.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:09.538+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:10.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:10.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:10.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:10.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:11.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:11.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:11.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:11.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:12.399 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:12.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:12.500 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:12.499+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:13.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:13.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:13.541 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:13.540+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:14.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:14.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:14.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:14.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:15.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:15.349+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:15.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:15.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:16.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:16.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:16.566 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:16.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:17.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:17.334+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:17.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:17.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:18.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:18.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:18.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:18.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:19.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:19.318+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:19.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:19.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:20.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:20.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:20.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:20.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:21.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:21.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:21.552 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:21.551+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:22.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:22.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:22.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:22.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:23.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:23.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:23.531 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:23.531+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:24.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:24.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:24.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:24.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:25.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:25.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:25.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:25.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:26.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:26.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:26.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:26.593+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:27.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:27.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:27.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:27.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:28.350 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:28.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:28.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:28.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:29.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:29.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:29.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:29.556+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:30.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:30.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:30.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:30.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:31.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:31.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:31.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:31.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:32.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:32.410+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:32.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:32.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:33.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:33.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:33.592 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:33.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:34.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:34.342+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:34.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:34.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:35.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:35.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:35.572 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:35.571+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:36.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:36.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:36.554 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:36.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:37.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:37.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:37.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:37.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:38.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:38.347+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:38.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:38.536+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:39.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:39.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:39.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:39.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:40.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:40.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:40.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:40.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:41.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:41.317+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:41.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:41.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:42.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:42.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:42.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:42.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:43.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:43.325+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:43.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:43.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:44.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:44.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:44.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:44.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:45.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:45.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:45.569 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:45.568+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:46.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:46.424+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:46.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:46.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:47.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:47.462+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:47.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:47.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:48.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:48.423+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:48.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:48.546+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:49.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:49.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:49.577 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:49.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:50.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:50.487+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:50.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:50.613+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:51.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:51.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:51.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:51.654+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:52.559 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:52.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:52.652 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:52.651+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:53.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:53.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:53.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:53.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:54.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:54.580+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:54.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:54.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:55.578 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:55.579+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:55.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:55.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:56.597 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:56.597+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:56.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:56.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:57.611 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:57.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:57.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:57.726+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:58.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:58.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:58.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:58.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:59.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:50:59.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:50:59.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:50:59.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:00.578 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:00.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:00.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:00.763+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:01.628 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:01.627+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:01.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:01.766+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:02.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:02.595+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:02.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:02.722+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:03.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:03.584+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:03.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:03.680+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:04.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:04.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:04.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:04.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:05.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:05.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:05.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:05.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:06.587 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:06.586+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:06.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:06.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:07.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:07.569+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:07.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:07.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:08.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:08.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:08.681 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:08.680+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:09.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:09.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:09.665 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:09.664+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:10.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:10.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:10.638 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:10.638+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:11.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:11.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:11.663 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:11.663+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:12.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:12.565+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:12.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:12.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:13.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:13.609+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:13.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:13.662+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:14.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:14.583+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:14.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:14.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:15.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:15.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:15.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:15.704+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:16.590 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:16.590+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:16.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:16.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:17.629 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:17.628+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:17.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:17.733+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:18.639 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:18.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:18.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:18.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:19.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:19.641+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:19.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:19.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:20.678 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:20.678+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:20.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:20.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:21.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:21.633+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:21.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:21.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:22.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:22.634+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:22.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:22.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:23.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:23.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:23.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:23.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:24.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:24.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:24.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:24.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:25.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:25.659+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:25.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:25.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:26.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:26.700+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:26.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:26.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:27.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:27.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:27.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:27.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:28.710 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:28.709+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:28.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:28.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:29.736 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:29.736+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:29.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:29.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:30.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:30.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:30.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:30.899+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:31.812 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:31.811+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:31.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:31.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:32.806 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:32.806+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:32.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:32.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:33.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:33.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:33.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:33.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:34.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:34.797+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:34.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:34.843+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:35.752 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:35.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:35.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:35.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:36.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:36.715+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:36.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:36.796+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:37.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:37.751+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:37.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:37.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:38.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:38.740+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:38.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:38.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:39.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:39.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:39.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:39.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:40.765 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:40.765+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:40.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:40.778+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:41.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:41.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:41.810 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:41.811+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:42.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:42.697+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:42.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:42.800+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:43.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:43.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:43.774 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:43.774+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:44.720 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:44.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:44.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:44.798+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:45.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:45.759+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:45.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:45.789+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:46.736 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:46.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:46.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:46.772+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:47.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:47.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:47.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:47.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:48.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:48.733+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:48.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:48.782+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:49.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:49.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:49.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:49.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:50.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:50.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:50.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:50.861+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:51.677 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:51.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:51.890 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:51.890+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:52.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:52.726+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:52.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:52.852+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:53.695 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:53.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:53.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:53.818+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:54.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:54.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:54.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:54.771+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:55.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:55.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:55.728 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:55.727+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:56.684 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:56.683+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:56.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:56.683+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:57.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:57.636+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:57.649 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:57.649+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:58.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:58.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:58.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:58.671+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:59.639 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:51:59.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:51:59.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:51:59.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:00.678 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:00.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:00.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:00.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:01.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:01.641+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:01.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:01.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:02.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:02.615+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:02.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:02.765+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:03.596 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:03.596+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:03.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:03.805+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:04.606 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:04.605+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:04.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:04.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:05.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:05.635+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:05.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:05.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:06.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:06.667+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:06.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:06.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:07.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:07.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:07.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:07.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:08.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:08.670+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:08.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:08.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:09.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:09.699+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:09.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:09.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:10.680 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:10.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:10.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:10.948+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:11.686 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:11.686+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:11.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:11.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:12.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:12.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:12.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:12.990+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:13.662 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:13.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:14.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:14.037+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:14.654 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:14.653+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:14.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:14.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:15.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:15.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:15.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:15.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:16.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:16.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:16.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:16.984+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:17.620 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:17.619+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:18.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:18.007+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:18.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:18.616+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:18.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:18.962+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:19.611 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:19.611+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:19.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:19.948+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:20.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:20.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:20.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:20.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:21.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:21.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:22.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:22.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:22.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:22.569+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:23.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:23.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:23.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:23.570+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:24.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:24.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:24.611 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:24.612+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:25.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:25.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:25.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:25.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:26.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:26.052+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:26.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:26.601+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:27.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:27.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:27.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:27.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:28.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:28.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:28.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:28.601+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:29.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:29.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:29.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:29.577+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:30.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:30.102+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:30.620 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:30.620+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:31.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:31.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:31.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:31.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:32.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:32.037+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:32.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:32.630+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:33.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:33.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:33.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:33.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:34.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:34.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:34.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:34.630+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:35.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:35.124+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:35.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:35.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:36.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:36.156+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:36.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:36.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:37.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:37.114+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:37.732 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:37.731+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:38.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:38.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:38.703 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:38.702+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:39.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:39.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:39.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:39.720+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:40.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:40.092+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:40.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:40.692+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:41.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:41.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:41.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:41.656+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:42.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:42.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:42.651 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:42.651+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:43.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:43.092+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:43.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:43.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:44.135 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:44.135+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:44.663 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:44.662+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:45.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:45.101+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:45.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:45.635+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:46.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:46.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:46.645 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:46.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:47.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:47.103+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:47.634 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:47.634+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:48.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:48.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:48.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:48.639+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:49.089 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:49.088+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:49.614 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:49.614+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:50.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:50.129+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:50.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:50.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:51.175 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:51.174+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:51.650 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:51.650+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:52.217 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:52.217+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:52.677 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:52.677+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:53.221 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:53.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:53.654 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:53.654+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:54.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:54.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:54.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:54.665+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:55.262 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:55.262+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:55.713 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:55.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:56.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:56.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:56.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:56.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:57.311 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:57.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:57.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:57.681+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:58.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:58.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:58.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:58.636+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:59.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:52:59.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:52:59.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:52:59.681+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:00.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:00.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:00.714 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:00.713+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:01.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:01.329+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:01.761 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:01.760+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:02.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:02.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:02.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:02.803+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:03.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:03.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:03.821 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:03.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:04.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:04.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:04.810 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:04.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:05.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:05.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:05.789 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:05.788+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:06.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:06.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:06.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:06.838+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:07.331 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:07.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:07.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:07.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:08.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:08.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:08.794 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:08.795+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:09.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:09.271+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:09.803 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:09.804+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:10.299 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:10.299+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:10.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:10.824+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:11.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:11.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:11.813 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:11.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:12.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:12.254+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:12.850 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:12.850+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:13.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:13.257+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:13.899 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:13.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:14.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:14.257+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:14.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:14.941+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:15.251 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:15.251+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:15.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:15.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:16.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:16.237+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:16.925 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:16.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:17.226 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:17.225+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:17.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:17.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:18.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:18.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:18.870 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:18.869+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:19.219 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:19.218+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:19.829 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:19.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:20.241 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:20.241+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:20.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:20.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:21.266 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:21.265+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:21.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:21.874+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:22.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:22.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:22.913 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:22.913+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:23.225 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:23.225+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:23.917 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:23.917+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:24.207 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:24.206+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:24.923 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:24.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:25.221 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:25.220+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:25.950 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:25.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:26.223 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:26.222+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:26.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:26.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:27.221 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:27.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:28.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:28.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:28.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:28.258+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:29.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:29.048+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:29.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:29.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:30.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:30.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:30.333 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:30.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:30.974 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:30.974+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:31.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:31.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:31.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:31.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:32.348 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:32.347+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:33.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:33.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:33.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:33.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:33.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:33.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:34.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:34.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:34.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:34.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:35.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:35.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:35.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:35.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:36.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:36.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:36.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:36.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:37.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:37.364+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:37.953 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:37.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:38.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:38.391+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:38.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:38.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:39.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:39.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:40.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:40.018+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:40.319 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:40.318+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:41.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:41.062+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:41.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:41.333+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:42.059 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:42.058+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:42.337 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:42.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:43.061 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:43.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:43.300 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:43.299+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:44.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:44.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:44.299 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:44.299+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:45.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:45.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:45.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:45.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:46.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:46.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:46.280 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:46.279+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:47.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:47.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:47.322 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:47.322+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:48.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:48.182+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:48.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:48.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:49.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:49.175+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:49.292 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:49.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:50.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:50.181+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:50.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:50.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:51.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:51.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:51.355 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:51.356+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:52.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:52.261+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:52.365 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:52.365+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:53.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:53.284+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:53.350 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:53.350+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:54.270 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:54.270+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:54.325 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:54.326+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:55.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:55.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:55.337 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:55.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:56.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:56.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:56.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:56.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:57.270 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:57.270+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:57.346 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:57.346+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:58.302 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:58.302+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:58.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:58.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:59.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:53:59.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:53:59.330 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:53:59.331+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:00.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:00.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:00.328 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:00.328+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:01.289 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:01.288+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:01.343 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:01.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:02.284 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:02.284+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:02.314 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:02.314+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:03.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:03.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:03.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:03.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:04.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:04.202+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:04.282 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:04.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:05.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:05.217+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:05.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:05.265+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:06.246 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:06.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:06.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:06.267+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:07.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:07.236+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:07.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:07.278+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:08.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:08.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:08.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:08.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:09.251 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:09.250+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:09.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:09.264+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:10.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:10.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:10.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:10.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:11.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:11.173+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:11.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:11.191+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:12.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:12.216+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:12.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:12.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:13.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:13.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:13.201 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:13.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:14.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:14.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:14.229 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:14.228+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:15.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:15.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:15.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:15.184+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:16.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:16.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:16.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:16.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:17.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:17.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:17.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:17.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:18.135 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:18.134+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:18.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:18.135+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:19.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:19.153+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:19.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:19.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:20.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:20.159+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:20.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:20.202+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:21.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:21.196+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:21.208 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:21.208+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:22.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:22.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:22.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:22.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:23.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:23.214+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:23.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:23.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:24.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:24.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:24.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:24.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:25.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:25.259+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:25.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:25.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:26.232 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:26.232+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:26.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:26.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:27.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:27.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:27.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:27.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:28.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:28.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:28.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:28.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:29.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:29.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:29.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:29.283+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:30.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:30.189+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:30.289 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:30.289+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:31.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:31.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:31.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:31.249+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:32.206 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:32.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:32.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:32.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:33.212 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:33.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:33.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:33.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:34.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:34.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:34.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:34.233+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:35.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:35.176+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:35.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:35.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:36.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:36.196+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:36.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:36.300+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:37.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:37.217+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:37.308 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:37.308+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:38.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:38.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:38.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:38.278+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:39.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:39.277+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:39.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:39.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:40.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:40.241+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:40.281 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:40.281+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:41.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:41.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:41.285 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:41.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:42.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:42.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:42.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:42.272+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:43.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:43.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:43.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:43.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:44.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:44.224+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:44.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:44.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:45.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:45.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:45.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:45.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:46.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:46.175+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:46.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:46.309+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:47.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:47.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:47.275 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:47.274+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:48.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:48.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:48.260 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:48.259+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:49.207 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:49.206+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:49.307 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:49.307+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:50.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:50.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:50.296 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:50.295+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:51.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:51.250+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:51.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:51.261+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:52.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:52.202+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:52.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:52.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:53.216 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:53.216+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:53.248 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:53.248+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:54.226 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:54.225+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:54.258 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:54.258+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:55.213 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:55.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:55.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:55.233+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:56.229 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:56.228+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:56.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:56.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:57.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:57.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:57.195 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:57.195+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:58.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:58.164+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:58.179 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:58.179+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:59.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:54:59.124+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:54:59.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:54:59.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:00.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:00.111+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:00.138 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:00.137+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:01.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:01.080+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:01.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:01.113+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:02.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:02.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:02.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:02.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:03.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:03.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:03.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:03.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:04.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:04.074+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:04.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:04.204+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:05.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:05.042+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:05.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:05.239+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:06.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:06.028+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:06.269 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:06.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:07.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:07.049+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:07.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:07.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:08.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:08.055+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:08.293 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:08.293+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:09.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:09.068+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:09.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:09.270+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:10.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:10.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:10.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:10.317+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:11.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:11.051+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:11.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:11.334+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:12.018 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:12.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:12.318 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:12.318+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:13.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:13.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:13.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:13.360+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:14.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:14.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:14.367 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:14.367+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:14.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:14.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:15.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:15.385+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:16.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:16.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:16.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:16.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:16.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:16.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:17.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:17.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:18.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:18.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:18.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:18.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:19.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:19.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:19.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:19.373+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:20.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:20.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:20.416 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:20.415+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:21.040 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:21.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:21.394 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:21.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:22.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:22.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:22.419 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:22.418+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:23.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:23.003+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:23.419 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:23.419+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:24.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:24.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:24.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:24.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:25.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:25.018+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:25.420 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:25.420+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:25.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:25.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:26.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:26.402+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:26.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:26.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:27.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:27.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:28.011 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:28.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:28.374 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:28.375+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:29.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:29.062+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:29.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:29.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:30.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:30.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:30.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:30.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:31.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:31.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:31.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:31.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:32.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:32.132+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:32.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:32.501+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:33.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:33.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:33.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:33.524+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:34.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:34.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:34.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:34.544+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:35.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:35.050+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:35.563 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:35.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:36.049 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:36.048+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:36.522 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:36.521+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:37.095 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:37.094+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:37.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:37.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:38.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:38.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:38.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:38.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:39.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:39.085+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:39.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:39.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:40.092 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:40.091+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:40.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:40.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:41.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:41.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:41.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:41.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:42.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:42.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:42.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:42.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:43.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:43.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:43.555 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:43.554+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:44.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:44.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:44.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:44.517+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:45.064 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:45.027+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:45.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:45.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:45.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:45.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:46.518 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:46.517+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:46.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:46.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:47.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:47.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:48.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:48.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:48.545 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:48.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:49.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:49.031+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:49.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:49.575+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:50.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:50.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:50.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:50.527+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:51.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:51.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:51.560 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:51.559+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:52.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:52.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:52.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:52.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:53.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:53.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:53.498 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:53.497+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:53.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:53.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:54.462 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:54.461+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:55.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:55.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:55.460 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:55.459+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:55.981 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:55.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:56.494 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:56.493+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:57.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:57.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:57.459 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:57.458+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:58.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:58.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:58.449 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:58.448+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:59.094 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:55:59.093+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:55:59.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:55:59.411+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:00.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:00.046+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:00.450 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:00.449+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:01.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:01.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:01.412 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:01.412+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:02.047 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:02.047+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:02.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:02.391+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:03.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:03.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:03.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:03.379+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:04.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:04.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:04.350 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:04.350+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:04.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:04.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:05.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:05.350+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:05.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:05.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:06.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:06.399+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:06.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:06.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:07.432 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:07.432+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:07.908 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:07.907+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:08.482 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:08.481+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:08.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:08.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:09.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:09.463+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:09.869 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:09.870+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:10.472 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:10.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:10.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:10.893+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:11.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:11.476+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:11.903 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:11.903+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:12.459 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:12.460+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:12.868 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:12.867+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:13.454 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:13.454+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:13.893 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:13.894+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:14.502 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:14.502+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:14.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:14.942+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:15.497 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:15.498+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:15.912 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:15.912+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:16.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:16.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:16.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:16.902+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:17.495 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:17.495+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:17.941 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:17.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:18.520 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:18.520+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:18.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:18.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:19.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:19.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:19.901 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:19.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:20.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:20.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:20.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:20.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:21.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:21.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:21.979 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:21.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:22.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:22.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:22.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:22.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:23.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:23.530+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:23.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:23.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:24.527 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:24.526+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:24.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:24.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:25.519 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:25.519+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:26.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:26.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:26.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:26.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:26.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:26.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:27.443 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:27.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:27.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:27.959+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:28.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:28.446+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:29.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:29.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:29.448 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:29.447+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:30.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:30.017+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:30.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:30.439+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:31.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:31.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:31.473 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:31.472+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:32.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:32.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:32.506 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:32.505+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:33.066 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:33.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:33.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:33.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:34.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:34.018+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:34.555 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:34.555+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:34.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:34.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:35.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:35.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:35.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:35.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:36.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:36.600+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:36.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:36.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:37.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:37.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:38.015 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:38.014+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:38.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:38.661+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:38.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:38.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:39.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:39.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:39.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:39.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:40.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:40.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:41.034 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:41.033+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:41.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:41.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:42.046 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:42.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:42.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:42.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:43.096 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:43.095+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:43.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:43.740+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:44.105 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:44.105+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:44.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:44.776+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:45.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:45.086+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:45.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:45.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:46.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:46.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:46.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:46.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:47.081 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:47.080+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:47.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:47.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:48.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:48.038+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:48.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:48.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:49.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:49.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:49.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:49.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:50.095 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:50.094+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:50.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:50.843+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:51.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:51.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:51.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:51.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:53.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:52.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:53.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:52.864+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:53.061 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:53.060+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:53.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:53.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:54.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:54.043+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:54.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:54.811+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:55.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:55.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:55.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:55.824+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:56.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:56.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:56.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:56.824+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:57.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:57.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:57.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:57.811+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:58.078 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:58.079+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:58.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:58.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:59.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:56:59.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:56:59.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:56:59.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:00.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:00.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:00.760 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:00.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:01.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:01.132+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:01.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:01.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:02.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:02.085+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:02.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:02.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:03.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:03.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:03.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:03.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:04.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:04.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:04.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:04.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:05.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:05.070+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:05.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:05.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:06.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:06.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:06.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:06.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:06.994 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:06.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:07.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:07.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:07.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:07.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:08.789 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:08.788+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:09.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:09.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:09.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:09.765+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:10.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:10.027+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:10.722 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:10.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:11.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:11.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:11.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:11.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:11.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:11.999+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:12.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:12.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:12.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:12.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:13.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:13.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:13.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:13.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:14.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:14.771+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:14.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:14.992+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:15.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:15.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:16.013 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:16.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:16.723 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:16.723+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:16.991 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:16.990+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:17.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:17.730+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:18.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:18.011+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:18.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:18.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:18.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:18.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:19.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:19.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:19.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:19.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:20.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:20.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:20.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:20.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:21.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:21.679+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:22.004 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:22.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:22.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:22.667+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:23.001 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:23.001+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:23.664 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:23.663+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:23.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:23.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:24.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:24.627+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:24.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:24.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:25.636 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:25.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:25.995 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:25.994+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:26.668 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:26.668+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:27.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:27.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:27.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:27.716+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:28.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:28.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:28.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:28.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:28.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:28.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:29.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:29.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:29.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:29.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:30.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:30.733+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:31.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:31.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:31.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:31.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:31.978 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:31.977+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:32.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:32.783+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:32.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:32.938+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:33.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:33.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:33.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:33.969+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:34.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:34.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:34.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:34.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:35.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:35.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:35.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:35.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:36.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:36.705+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:36.983 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:36.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:37.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:37.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:38.030 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:38.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:38.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:38.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:39.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:39.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:39.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:39.733+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:40.116 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:40.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:40.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:40.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:41.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:41.124+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:41.718 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:41.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:42.140 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:42.140+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:42.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:42.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:43.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:43.146+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:43.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:43.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:44.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:44.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:44.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:44.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:45.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:45.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:45.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:45.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:46.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:46.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:46.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:46.768+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:47.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:47.085+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:47.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:47.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:48.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:48.111+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:48.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:48.802+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:49.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:49.141+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:49.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:49.840+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:50.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:50.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:50.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:50.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:51.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:51.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:51.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:51.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:52.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:52.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:52.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:52.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:53.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:53.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:53.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:53.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:54.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:54.183+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:54.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:54.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:55.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:55.207+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:55.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:55.904+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:56.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:56.238+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:56.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:56.860+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:57.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:57.269+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:57.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:57.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:58.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:58.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:58.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:58.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:59.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:57:59.252+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:57:59.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:57:59.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:00.245 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:00.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:00.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:00.865+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:01.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:01.282+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:01.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:01.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:02.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:02.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:02.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:02.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:03.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:03.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:03.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:03.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:04.245 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:04.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:04.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:04.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:05.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:05.282+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:05.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:05.941+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:06.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:06.284+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:06.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:06.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:07.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:07.255+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:07.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:07.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:08.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:08.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:08.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:08.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:09.260 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:09.260+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:09.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:09.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:10.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:10.213+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:10.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:10.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:11.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:11.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:11.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:11.960+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:12.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:12.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:12.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:12.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:13.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:13.189+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:13.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:13.947+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:14.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:14.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:14.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:14.922+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:15.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:15.239+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:15.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:15.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:16.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:16.260+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:16.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:16.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:17.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:17.248+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:17.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:17.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:18.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:18.255+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:18.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:18.898+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:19.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:19.264+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:19.920 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:19.919+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:20.228 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:20.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:20.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:20.909+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:21.260 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:21.259+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:21.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:21.875+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:22.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:22.293+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:22.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:22.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:23.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:23.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:23.863 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:23.862+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:24.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:24.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:24.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:24.841+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:25.234 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:25.234+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:25.867 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:25.866+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:26.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:26.250+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:26.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:26.818+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:27.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:27.202+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:27.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:27.822+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:28.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:28.186+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:28.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:28.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:29.174 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:29.174+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:29.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:29.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:30.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:30.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:30.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:30.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:31.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:31.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:31.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:31.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:32.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:32.234+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:32.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:32.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:33.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:33.236+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:33.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:33.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:34.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:34.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:34.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:34.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:35.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:35.247+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:35.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:35.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:36.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:36.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:36.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:36.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:37.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:37.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:37.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:37.796+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:38.225 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:38.225+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:38.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:38.802+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:39.243 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:39.243+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:39.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:39.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:40.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:40.215+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:40.737 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:40.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:41.231 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:41.231+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:41.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:41.765+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:42.279 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:42.278+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:42.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:42.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:43.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:43.310+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:43.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:43.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:44.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:44.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:44.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:44.807+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:45.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:45.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:45.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:45.814+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:46.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:46.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:46.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:46.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:47.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:47.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:47.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:47.776+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:48.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:48.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:48.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:48.776+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:49.325 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:49.325+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:49.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:49.782+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:50.340 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:50.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:50.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:50.745+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:51.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:51.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:51.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:51.713+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:52.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:52.353+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:52.733 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:52.733+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:53.309 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:53.308+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:53.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:53.735+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:54.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:54.294+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:54.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:54.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:55.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:55.324+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:55.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:55.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:56.352 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:56.351+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:56.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:56.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:57.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:57.338+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:57.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:57.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:58.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:58.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:58.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:58.774+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:59.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:58:59.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:58:59.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:58:59.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:00.460 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:00.460+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:00.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:00.770+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:01.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:01.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:01.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:01.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:02.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:02.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:02.778 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:02.777+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:03.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:03.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:03.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:03.740+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:04.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:04.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:04.789 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:04.788+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:05.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:05.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:05.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:05.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:06.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:06.488+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:06.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:06.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:07.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:07.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:07.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:07.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:08.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:08.544+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:08.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:08.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:09.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:09.561+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:09.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:09.698+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:10.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:10.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:10.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:10.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:11.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:11.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:11.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:11.692+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:12.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:12.569+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:12.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:12.654+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:13.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:13.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:13.679 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:13.680+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:14.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:14.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:14.707 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:14.707+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:15.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:15.570+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:15.679 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:15.679+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:16.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:16.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:16.703 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:16.704+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:17.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:17.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:17.687 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:17.688+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:18.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:18.622+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:19.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:18.732+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:19.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:19.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:19.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:19.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:20.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:20.580+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:20.717 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:20.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:21.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:21.623+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:21.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:21.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:22.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:22.627+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:22.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:22.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:23.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:23.646+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:23.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:23.803+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:24.626 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:24.625+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:24.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:24.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:25.641 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:25.641+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:25.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:25.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:26.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:26.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:26.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:26.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:27.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:27.579+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:27.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:27.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:28.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:28.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:28.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:28.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:29.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:29.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:29.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:29.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:30.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:30.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:30.699 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:30.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:31.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:31.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:31.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:31.672+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:32.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:32.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:32.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:32.693+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:33.578 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:33.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:33.652 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:33.651+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:34.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:34.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:34.672 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:34.671+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:35.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:35.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:35.710 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:35.709+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:36.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:36.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:36.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:36.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:37.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:37.560+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:37.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:37.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:38.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:38.518+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:38.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:38.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:39.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:39.543+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:39.740 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:39.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:40.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:40.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:40.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:40.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:41.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:41.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:41.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:41.692+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:42.561 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:42.560+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:42.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:42.684+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:43.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:43.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:43.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:43.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:44.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:44.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:44.698 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:44.697+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:45.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:45.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:45.737 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:45.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:46.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:46.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:46.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:46.783+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:47.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:47.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:47.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:47.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:48.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:48.489+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:48.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:48.803+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:49.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:49.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:49.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:49.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:50.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:50.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:50.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:50.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:51.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:51.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:51.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:51.796+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:52.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:52.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:52.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:52.790+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:53.484 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:53.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:53.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:53.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:54.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:54.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:54.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:54.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:55.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:55.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:55.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:55.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:56.454 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:56.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:56.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:56.798+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:57.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:57.493+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:57.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:57.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:58.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:58.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:58.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:58.770+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:59.512 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T15:59:59.513+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T15:59:59.753 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T15:59:59.753+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:00.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:00.518+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:00.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:00.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:01.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:01.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:01.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:01.771+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:02.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:02.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:02.731 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:02.731+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:03.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:03.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:03.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:03.777+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:04.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:04.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:04.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:04.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:05.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:05.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:05.777 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:05.717+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:06.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:06.446+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:06.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:06.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:07.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:07.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:07.695 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:07.695+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:08.453 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:08.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:08.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:08.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:09.462 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:09.461+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:09.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:09.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:10.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:10.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:10.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:10.771+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:11.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:11.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:11.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:11.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:12.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:12.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:12.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:12.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:13.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:13.570+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:13.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:13.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:14.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:14.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:14.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:14.780+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:15.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:15.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:15.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:15.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:16.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:16.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:16.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:16.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:17.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:17.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:17.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:17.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:18.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:18.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:18.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:18.856+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:19.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:19.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:19.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:19.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:20.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:20.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:20.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:20.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:21.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:21.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:21.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:21.840+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:22.442 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:22.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:22.799 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:22.796+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:23.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:23.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:23.776 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:23.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:24.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:24.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:24.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:24.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:25.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:25.370+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:25.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:25.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:26.351 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:26.350+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:26.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:26.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:27.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:27.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:27.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:27.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:28.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:28.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:28.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:28.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:29.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:29.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:29.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:29.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:30.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:30.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:30.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:30.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:31.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:31.440+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:31.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:31.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:32.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:32.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:32.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:32.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:33.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:33.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:33.959 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:33.959+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:34.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:34.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:34.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:34.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:35.413 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:35.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:35.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:35.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:36.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:36.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:36.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:36.914+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:37.342 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:37.341+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:37.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:37.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:38.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:38.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:38.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:38.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:39.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:39.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:39.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:39.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:40.285 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:40.284+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:40.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:40.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:41.308 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:41.307+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:41.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:41.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:42.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:42.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:42.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:42.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:43.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:43.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:43.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:43.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:44.229 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:44.229+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:44.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:44.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:45.183 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:45.183+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:46.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:46.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:46.136 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:46.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:47.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:47.044+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:47.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:47.107+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:48.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:48.007+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:48.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:48.115+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:49.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:49.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:49.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:49.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:50.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:50.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:50.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:50.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:50.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:50.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:51.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:51.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:51.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:51.954+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:52.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:52.106+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:52.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:52.947+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:53.121 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:53.121+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:53.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:53.984+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:54.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:54.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:54.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:54.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:55.069 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:55.068+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:55.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:55.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:56.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:56.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:56.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:56.912+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:57.066 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:57.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:57.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:57.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:58.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:58.064+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:58.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:58.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:59.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:00:59.055+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:00:59.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:00:59.957+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:00.088 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:00.087+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:00.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:00.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:01.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:01.106+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:02.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:02.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:02.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:02.134+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:02.998 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:02.997+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:03.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:03.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:04.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:04.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:04.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:04.152+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:04.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:04.954+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:05.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:05.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:05.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:05.908+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:06.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:06.102+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:06.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:06.900+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:07.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:07.136+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:07.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:07.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:08.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:08.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:08.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:08.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:09.105 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:09.104+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:09.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:09.996+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:10.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:10.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:10.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:10.965+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:11.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:11.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:11.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:11.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:12.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:12.181+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:12.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:12.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:13.141 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:13.140+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:13.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:13.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:14.134 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:14.134+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:14.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:14.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:15.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:15.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:15.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:15.966+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:16.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:16.221+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:16.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:16.974+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:17.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:17.259+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:17.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:17.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:18.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:18.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:18.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:18.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:19.304 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:19.303+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:19.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:19.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:20.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:20.342+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:20.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:20.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:21.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:21.297+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:21.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:21.874+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:22.326 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:22.326+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:22.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:22.866+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:23.286 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:23.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:23.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:23.849+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:24.323 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:24.322+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:24.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:24.804+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:25.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:25.359+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:25.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:25.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:26.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:26.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:26.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:26.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:27.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:27.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:27.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:27.801+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:28.334 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:28.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:28.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:28.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:29.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:29.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:29.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:29.768+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:30.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:30.423+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:30.747 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:30.747+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:31.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:31.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:31.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:31.746+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:32.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:32.419+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:32.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:32.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:33.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:33.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:33.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:33.738+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:34.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:34.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:34.748 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:34.748+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:35.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:35.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:35.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:35.702+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:36.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:36.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:36.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:36.697+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:37.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:37.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:37.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:37.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:38.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:38.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:38.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:38.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:39.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:39.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:39.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:39.699+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:40.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:40.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:40.682 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:40.682+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:41.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:41.490+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:41.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:41.713+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:42.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:42.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:42.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:42.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:43.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:43.551+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:43.746 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:43.745+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:44.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:44.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:44.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:44.718+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:45.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:45.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:45.767 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:45.766+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:46.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:46.490+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:46.741 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:46.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:47.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:47.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:47.765 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:47.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:48.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:48.502+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:48.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:48.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:49.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:49.522+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:49.692 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:49.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:50.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:50.506+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:50.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:50.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:51.502 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:51.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:51.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:51.665+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:52.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:52.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:52.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:52.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:53.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:53.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:53.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:53.620+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:54.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:54.506+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:54.639 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:54.638+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:55.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:55.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:55.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:55.639+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:56.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:56.423+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:56.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:56.610+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:57.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:57.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:57.657 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:57.656+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:58.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:58.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:58.609 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:58.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:59.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:01:59.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:01:59.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:01:59.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:00.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:00.513+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:00.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:00.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:01.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:01.554+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:01.606 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:01.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:02.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:02.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:02.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:02.639+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:03.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:03.531+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:03.626 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:03.625+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:04.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:04.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:04.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:04.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:05.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:05.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:05.594 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:05.594+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:06.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:06.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:06.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:06.613+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:07.564 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:07.563+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:07.584 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:07.583+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:08.543 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:08.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:08.577 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:08.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:09.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:09.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:09.582 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:09.581+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:10.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:10.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:10.562 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:10.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:11.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:11.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:11.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:11.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:12.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:12.544+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:12.589 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:12.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:13.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:13.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:13.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:13.619+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:14.481 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:14.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:14.650 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:14.650+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:15.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:15.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:15.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:15.634+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:16.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:16.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:16.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:16.666+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:17.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:17.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:17.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:17.693+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:18.412 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:18.412+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:18.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:18.692+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:19.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:19.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:19.665 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:19.666+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:20.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:20.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:20.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:20.685+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:21.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:21.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:21.693 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:21.694+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:22.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:22.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:22.652 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:22.652+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:23.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:23.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:23.643 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:23.643+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:24.378 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:24.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:24.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:24.620+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:25.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:25.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:25.647 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:25.646+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:26.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:26.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:26.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:26.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:27.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:27.363+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:27.617 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:27.616+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:28.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:28.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:28.620 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:28.619+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:29.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:29.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:29.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:29.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:30.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:30.478+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:30.602 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:30.601+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:31.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:31.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:31.650 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:31.649+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:32.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:32.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:32.686 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:32.685+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:33.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:33.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:33.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:33.696+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:34.585 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:34.585+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:34.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:34.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:35.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:35.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:35.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:35.629+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:36.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:36.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:36.679 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:36.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:37.497 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:37.496+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:37.662 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:37.662+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:38.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:38.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:38.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:38.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:39.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:39.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:39.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:39.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:40.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:40.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:40.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:40.764+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:41.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:41.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:41.775 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:41.775+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:42.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:42.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:42.729 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:42.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:43.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:43.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:43.702 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:43.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:44.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:44.419+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:44.679 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:44.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:45.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:45.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:45.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:45.639+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:46.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:46.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:46.619 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:46.618+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:47.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:47.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:47.653 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:47.653+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:48.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:48.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:48.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:48.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:49.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:49.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:49.627 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:49.626+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:50.505 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:50.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:50.639 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:50.639+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:51.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:51.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:51.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:51.676+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:52.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:52.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:52.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:52.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:53.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:53.568+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:53.737 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:53.736+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:54.602 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:54.602+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:54.689 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:54.689+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:55.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:55.580+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:55.691 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:55.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:56.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:56.573+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:56.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:56.674+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:57.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:57.602+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:57.679 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:57.678+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:58.598 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:58.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:58.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:58.713+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:59.570 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:02:59.569+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:02:59.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:02:59.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:00.525 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:00.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:00.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:00.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:01.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:01.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:01.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:01.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:02.507 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:02.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:02.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:02.829+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:03.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:03.517+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:03.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:03.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:04.526 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:04.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:04.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:04.805+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:05.525 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:05.525+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:05.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:05.829+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:06.536 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:06.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:06.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:06.877+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:07.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:07.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:07.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:07.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:08.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:08.567+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:08.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:08.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:09.583 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:09.583+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:09.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:09.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:10.578 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:10.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:10.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:10.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:11.601 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:11.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:12.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:12.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:12.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:12.570+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:13.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:13.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:13.565 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:13.564+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:13.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:13.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:14.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:14.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:14.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:14.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:15.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:15.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:16.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:16.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:16.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:16.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:17.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:17.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:17.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:17.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:17.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:17.997+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:18.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:18.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:19.036 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:19.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:19.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:19.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:20.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:20.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:20.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:20.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:20.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:20.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:21.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:21.531+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:21.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:21.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:22.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:22.546+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:23.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:23.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:23.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:23.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:23.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:23.965+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:24.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:24.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:25.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:25.007+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:25.574 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:25.573+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:26.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:26.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:26.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:26.582+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:26.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:26.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:27.610 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:27.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:28.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:28.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:28.587 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:28.586+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:29.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:29.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:29.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:29.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:30.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:30.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:30.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:30.530+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:31.024 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:31.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:31.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:31.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:32.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:32.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:32.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:32.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:32.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:32.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:33.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:33.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:34.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:34.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:34.579 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:34.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:34.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:34.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:35.576 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:35.576+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:36.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:36.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:36.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:36.591+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:37.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:37.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:37.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:37.555+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:38.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:38.015+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:38.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:38.582+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:39.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:39.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:39.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:39.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:40.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:40.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:40.547 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:40.546+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:41.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:41.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:41.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:41.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:42.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:42.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:42.611 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:42.610+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:42.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:42.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:43.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:43.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:44.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:44.022+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:44.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:44.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:45.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:45.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:45.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:45.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:46.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:46.069+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:46.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:46.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:47.112 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:47.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:47.643 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:47.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:48.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:48.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:48.621 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:48.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:49.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:49.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:49.620 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:49.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:50.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:50.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:50.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:50.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:51.100 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:51.100+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:51.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:51.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:52.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:52.150+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:52.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:52.741+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:53.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:53.185+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:53.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:53.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:54.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:54.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:54.763 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:54.764+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:55.201 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:55.201+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:55.807 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:55.807+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:56.196 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:56.195+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:56.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:56.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:57.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:57.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:57.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:57.843+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:58.166 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:58.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:58.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:58.838+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:59.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:03:59.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:03:59.853 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:03:59.852+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:00.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:00.153+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:00.839 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:00.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:01.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:01.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:01.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:01.800+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:02.165 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:02.165+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:02.770 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:02.770+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:03.144 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:03.143+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:03.765 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:03.764+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:04.102 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:04.102+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:04.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:04.800+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:05.119 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:05.118+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:05.842 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:05.842+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:06.087 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:06.086+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:06.800 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:06.799+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:07.116 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:07.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:07.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:07.797+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:08.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:08.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:08.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:08.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:09.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:09.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:09.787 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:09.786+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:10.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:10.048+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:10.758 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:10.757+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:11.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:11.069+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:11.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:11.772+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:12.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:12.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:12.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:12.798+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:13.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:13.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:13.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:13.847+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:14.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:14.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:14.847 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:14.847+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:15.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:15.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:15.827 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:15.826+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:16.107 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:16.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:16.784 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:16.784+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:17.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:17.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:17.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:17.807+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:18.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:18.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:18.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:18.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:19.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:19.140+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:19.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:19.733+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:20.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:20.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:20.688 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:20.687+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:21.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:21.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:21.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:21.701+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:22.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:22.051+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:22.717 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:22.716+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:23.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:23.090+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:23.700 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:23.700+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:24.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:24.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:24.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:24.714+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:25.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:25.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:25.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:25.673+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:26.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:26.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:26.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:26.680+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:27.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:27.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:27.644 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:27.643+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:28.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:28.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:28.682 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:28.681+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:29.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:29.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:29.688 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:29.687+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:29.991 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:29.990+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:30.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:30.712+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:30.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:30.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:31.667 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:31.666+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:31.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:31.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:32.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:32.640+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:33.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:33.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:33.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:33.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:33.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:33.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:34.631 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:34.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:34.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:34.909+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:35.603 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:35.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:35.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:35.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:36.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:36.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:36.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:36.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:37.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:37.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:37.843 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:37.843+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:38.661 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:38.661+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:38.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:38.859+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:39.702 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:39.702+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:39.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:39.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:40.727 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:40.727+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:40.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:40.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:41.696 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:41.695+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:41.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:41.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:42.712 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:42.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:42.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:42.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:43.740 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:43.739+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:43.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:43.909+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:44.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:44.781+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:44.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:44.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:45.811 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:45.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:45.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:45.966+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:46.840 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:46.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:46.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:46.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:47.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:47.832+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:47.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:47.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:48.796 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:48.795+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:48.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:48.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:49.807 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:49.806+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:49.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:49.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:50.768 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:50.767+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:50.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:50.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:51.746 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:51.746+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:51.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:51.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:52.773 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:52.772+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:52.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:52.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:53.775 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:53.774+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:53.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:53.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:54.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:54.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:54.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:54.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:55.778 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:55.778+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:55.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:55.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:56.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:56.821+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:56.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:56.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:57.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:57.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:57.852 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:57.851+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:58.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:58.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:58.902 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:58.901+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:59.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:04:59.874+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:04:59.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:04:59.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:00.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:00.831+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:00.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:00.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:01.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:01.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:01.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:01.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:02.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:02.812+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:02.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:02.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:03.817 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:03.816+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:03.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:03.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:04.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:04.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:04.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:04.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:05.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:05.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:05.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:05.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:06.878 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:06.877+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:06.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:06.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:07.867 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:07.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:07.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:07.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:08.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:08.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:08.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:08.895+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:09.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:09.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:09.944 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:09.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:10.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:10.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:10.934 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:10.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:11.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:11.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:11.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:11.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:12.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:12.827+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:12.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:12.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:13.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:13.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:13.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:13.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:14.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:14.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:14.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:14.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:15.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:15.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:15.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:15.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:16.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:16.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:16.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:16.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:17.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:17.809+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:17.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:17.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:18.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:18.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:18.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:18.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:19.789 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:19.790+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:20.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:20.022+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:20.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:20.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:20.996 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:20.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:21.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:21.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:22.028 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:22.028+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:22.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:22.824+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:22.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:22.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:23.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:23.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:23.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:23.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:24.759 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:24.759+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:24.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:24.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:25.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:25.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:25.933 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:25.933+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:26.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:26.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:26.970 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:26.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:27.806 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:27.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:27.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:27.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:28.764 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:28.763+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:29.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:29.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:29.770 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:29.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:30.024 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:30.023+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:30.811 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:30.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:31.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:31.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:31.824 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:31.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:32.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:32.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:32.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:32.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:33.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:33.135+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:33.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:33.752+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:34.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:34.099+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:34.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:34.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:35.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:35.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:35.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:35.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:36.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:36.148+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:36.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:36.822+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:37.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:37.158+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:37.864 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:37.863+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:38.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:38.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:38.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:38.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:39.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:39.170+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:39.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:39.871+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:40.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:40.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:40.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:40.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:41.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:41.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:41.844 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:41.843+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:42.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:42.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:42.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:42.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:43.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:43.187+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:43.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:43.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:44.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:44.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:44.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:44.915+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:45.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:45.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:45.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:45.917+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:46.222 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:46.221+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:46.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:46.942+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:47.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:47.216+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:47.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:47.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:48.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:48.234+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:48.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:48.917+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:49.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:49.218+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:49.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:49.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:50.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:50.239+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:50.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:50.971+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:51.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:51.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:51.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:51.979+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:52.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:52.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:52.931 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T16:05:52.930+0000 7fcd7ebd3700 0 -- 172.21.15.69:0/2655470317 >> [v2:172.21.15.69:6800/86604,v1:172.21.15.69:6801/86604] conn(0x55d45ba84240 msgr2=0x7fcd6403c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-09-28T16:05:53.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:53.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:53.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:53.192+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:54.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:54.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:54.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:54.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:55.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:55.037+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:55.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:55.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:56.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:56.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:56.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:56.253+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:57.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:57.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:57.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:57.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:58.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:58.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:58.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:58.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:59.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:05:59.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:05:59.238 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:05:59.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:00.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:00.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:00.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:00.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:01.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:01.106+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:01.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:01.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:02.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:02.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:02.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:02.236+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:03.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:03.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:03.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:03.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:04.137 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:04.137+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:04.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:04.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:05.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:05.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:05.196 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:05.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:06.080 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:06.080+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:06.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:06.187+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:07.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:07.098+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:07.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:07.209+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:08.091 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:08.091+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:08.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:08.171+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:09.077 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:09.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:09.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:09.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:10.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:10.054+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:10.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:10.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:11.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:11.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:11.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:11.146+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:12.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:12.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:12.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:12.181+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:13.098 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:13.098+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:13.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:13.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:14.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:14.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:14.146 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:14.146+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:15.085 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:15.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:15.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:15.163+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:16.125 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:16.124+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:16.204 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:16.203+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:17.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:17.138+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:17.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:17.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:18.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:18.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:18.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:18.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:19.066 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:19.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:19.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:19.156+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:20.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:20.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:20.131 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:20.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:21.076 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:21.076+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:21.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:21.129+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:22.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:22.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:22.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:22.152+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:23.115 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:23.115+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:23.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:23.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:24.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:24.102+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:24.125 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:24.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:25.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:25.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:25.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:25.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:26.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:26.111+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:26.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:26.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:27.098 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:27.098+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:27.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:27.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:28.091 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:28.091+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:28.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:28.141+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:29.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:29.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:29.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:29.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:30.075 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:30.074+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:30.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:30.128+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:31.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:31.096+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:31.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:31.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:32.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:32.146+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:32.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:32.203+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:33.133 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:33.132+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:33.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:33.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:34.113 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:34.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:34.176 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:34.175+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:35.154 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:35.153+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:35.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:35.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:36.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:36.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:36.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:36.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:37.173 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:37.173+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:37.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:37.189+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:38.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:38.143+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:38.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:38.213+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:39.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:39.163+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:39.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:39.218+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:40.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:40.128+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:40.184 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:40.184+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:41.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:41.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:41.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:41.197+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:42.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:42.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:42.149 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:42.148+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:43.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:43.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:43.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:43.136+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:44.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:44.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:44.127 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:44.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:45.074 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:45.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:45.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:45.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:46.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:46.074+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:46.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:46.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:47.065 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:47.064+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:47.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:47.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:48.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:48.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:48.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:48.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:49.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:49.013+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:49.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:49.170+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:50.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:50.007+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:50.195 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:50.195+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:50.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:50.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:51.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:51.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:52.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:52.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:52.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:52.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:52.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:52.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:53.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:53.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:53.966 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:53.966+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:54.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:54.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:55.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:55.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:55.162 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:55.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:55.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:55.962+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:56.193 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:56.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:56.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:56.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:57.153 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:57.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:57.967 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:57.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:58.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:58.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:58.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:58.952+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:59.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:06:59.158+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:06:59.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:06:59.975+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:00.184 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:00.183+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:00.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:00.975+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:01.223 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:01.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:01.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:01.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:02.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:02.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:03.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:03.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:03.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:03.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:03.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:03.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:04.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:04.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:04.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:04.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:05.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:05.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:05.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:05.920+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:06.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:06.305+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:06.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:06.927+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:07.277 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:07.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:07.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:07.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:08.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:08.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:08.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:08.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:09.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:09.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:09.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:09.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:10.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:10.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:10.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:10.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:11.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:11.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:11.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:11.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:12.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:12.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:12.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:12.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:13.157 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:13.156+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:13.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:13.942+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:14.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:14.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:14.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:14.953+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:15.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:15.137+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:15.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:15.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:16.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:16.113+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:16.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:16.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:17.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:17.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:17.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:17.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:18.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:18.148+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:18.950 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:18.949+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:19.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:19.111+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:19.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:19.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:20.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:20.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:20.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:20.922+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:21.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:21.102+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:21.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:21.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:22.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:22.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:22.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:22.917+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:23.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:23.101+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:23.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:23.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:24.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:24.082+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:24.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:24.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:25.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:25.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:25.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:25.942+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:26.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:26.051+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:26.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:26.986+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:27.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:27.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:27.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:27.981+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:28.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:28.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:29.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:29.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:29.015 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:29.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:30.022 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:30.021+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:30.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:30.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:30.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:30.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:31.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:31.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:31.954 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:31.954+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:32.086 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:32.085+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:32.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:32.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:33.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:33.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:33.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:33.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:34.027 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:34.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:34.937 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:34.937+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:35.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:35.013+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:35.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:35.946+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:35.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:35.974+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:36.963 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:36.963+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:36.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:36.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:37.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:37.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:37.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:37.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:38.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:38.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:38.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:38.986+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:39.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:39.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:39.949 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:39.949+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:40.926 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:40.926+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:40.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:40.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:41.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:41.936+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:41.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:41.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:42.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:42.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:42.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:42.992+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:43.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:43.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:44.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:44.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:44.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:44.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:45.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:45.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:45.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:45.952+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:46.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:46.103+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:46.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:46.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:47.108 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:47.107+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:47.928 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:47.927+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:48.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:48.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:48.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:48.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:49.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:49.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:49.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:49.942+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:50.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:50.033+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:50.993 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:50.993+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:50.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:50.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:51.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:51.985+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:52.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:52.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:52.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:52.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:53.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:53.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:53.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:53.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:53.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:53.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:54.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:54.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:54.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:54.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:55.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:55.937+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:55.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:55.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:56.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:56.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:56.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:56.974+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:57.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:57.981+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:58.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:58.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:58.965 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:58.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:59.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:07:59.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:07:59.931 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:07:59.930+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:00.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:00.015+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:00.924 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:00.924+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:01.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:01.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:01.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:01.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:02.017 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:02.015+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:02.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:02.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:03.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:03.030+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:03.957 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:03.956+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:04.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:04.021+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:04.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:04.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:05.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:05.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:05.956 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:05.955+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:06.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:06.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:06.959 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:06.958+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:07.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:07.021+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:07.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:07.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:08.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:08.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:09.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:09.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:09.020 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:09.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:10.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:10.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:10.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:10.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:11.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:11.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:11.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:11.034+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:12.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:12.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:12.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:12.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:13.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:13.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:13.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:13.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:13.982 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:13.982+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:14.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:14.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:14.960 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:14.960+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:15.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:15.022+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:15.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:15.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:15.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:15.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:16.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:16.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:16.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:16.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:17.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:17.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:18.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:18.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:19.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:19.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:19.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:19.045+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:20.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:20.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:20.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:20.092+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:21.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:21.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:21.074 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:21.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:22.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:22.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:22.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:22.052+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:23.035 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:23.035+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:23.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:23.049+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:24.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:24.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:24.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:24.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:25.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:25.023+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:25.099 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:25.099+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:25.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:25.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:26.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:26.147+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:26.959 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:26.959+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:27.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:27.169+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:27.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:27.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:28.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:28.218+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:28.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:28.900+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:29.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:29.169+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:29.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:29.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:30.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:30.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:30.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:30.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:31.123 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:31.122+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:31.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:31.937+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:32.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:32.142+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:32.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:32.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:33.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:33.107+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:33.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:33.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:34.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:34.107+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:34.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:34.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:35.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:35.129+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:35.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:35.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:36.160 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:36.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:36.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:36.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:37.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:37.163+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:37.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:37.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:38.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:38.131+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:38.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:38.915+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:39.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:39.083+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:39.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:39.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:40.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:40.113+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:40.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:40.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:41.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:41.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:41.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:41.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:42.159 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:42.159+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:42.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:42.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:43.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:43.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:43.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:43.879+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:44.218 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:44.217+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:44.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:44.912+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:45.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:45.255+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:45.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:45.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:46.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:46.286+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:46.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:46.877+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:47.250 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:47.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:47.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:47.915+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:48.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:48.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:48.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:48.962+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:49.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:49.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:49.983 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:49.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:50.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:50.294+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:50.982 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:50.981+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:51.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:51.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:51.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:51.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:52.322 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:52.321+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:52.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:52.992+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:53.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:53.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:53.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:53.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:54.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:54.338+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:54.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:54.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:55.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:55.356+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:55.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:55.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:56.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:56.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:56.983 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:56.982+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:57.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:57.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:57.976 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:57.975+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:58.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:58.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:59.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:08:59.013+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:08:59.292 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:08:59.291+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:00.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:00.001+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:00.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:00.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:00.991 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:00.990+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:01.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:01.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:01.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:01.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:02.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:02.365+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:03.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:03.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:03.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:03.410+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:04.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:04.055+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:04.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:04.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:05.082 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:05.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:05.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:05.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:06.095 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:06.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:06.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:06.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:07.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:07.126+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:07.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:07.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:08.139 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:08.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:08.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:08.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:09.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:09.185+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:09.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:09.419+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:10.235 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:10.235+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:10.452 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:10.452+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:11.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:11.238+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:11.428 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:11.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:12.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:12.222+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:12.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:12.444+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:13.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:13.181+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:13.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:13.410+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:14.169 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:14.169+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:14.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:14.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:15.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:15.128+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:15.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:15.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:16.123 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:16.123+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:16.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:16.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:17.141 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:17.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:17.420 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:17.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:18.171 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:18.171+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:18.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:18.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:19.134 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:19.133+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:19.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:19.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:20.106 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:20.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:20.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:20.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:21.128 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:21.127+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:21.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:21.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:22.140 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:22.139+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:22.430 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:22.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:23.111 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:23.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:23.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:23.432+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:24.130 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:24.129+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:24.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:24.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:25.176 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:25.175+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:25.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:25.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:26.172 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:26.172+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:26.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:26.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:27.163 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:27.163+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:27.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:27.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:28.182 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:28.181+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:28.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:28.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:29.178 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:29.177+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:29.437 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:29.437+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:30.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:30.146+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:30.442 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:30.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:31.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:31.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:31.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:31.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:32.120 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:32.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:32.477 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:32.476+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:33.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:33.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:33.476 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:33.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:34.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:34.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:34.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:34.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:35.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:35.066+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:35.468 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:35.468+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:36.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:36.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:36.481 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:36.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:37.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:37.053+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:37.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:37.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:38.053 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:38.053+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:38.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:38.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:39.100 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:39.099+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:39.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:39.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:40.093 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:40.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:40.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:40.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:41.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:41.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:41.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:41.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:42.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:42.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:42.432 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:42.431+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:43.034 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:43.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:43.455 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:43.454+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:44.057 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:44.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:44.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:44.417+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:45.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:45.057+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:45.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:45.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:46.016 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:46.016+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:46.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:46.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:47.030 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:47.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:47.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:47.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:47.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:47.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:48.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:48.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:48.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:48.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:49.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:49.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:49.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:49.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:50.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:50.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:50.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:50.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:51.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:51.425+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:52.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:52.017+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:52.392 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:52.391+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:53.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:53.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:53.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:53.436+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:54.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:54.088+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:54.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:54.459+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:55.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:55.110+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:55.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:55.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:56.078 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:56.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:56.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:56.480+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:57.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:57.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:57.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:57.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:57.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:57.997+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:58.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:58.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:59.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:09:59.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:09:59.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:09:59.489+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:00.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:00.073+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:00.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:00.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:01.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:01.119+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:01.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:01.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:02.167 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:02.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:02.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:02.482+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:03.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:03.154+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:03.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:03.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:04.131 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:04.130+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:04.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:04.526+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:05.126 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:05.125+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:05.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:05.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:06.162 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:06.161+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:06.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:06.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:07.137 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:07.136+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:07.493 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:07.492+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:08.156 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:08.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:08.477 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:08.477+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:09.153 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:09.152+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:09.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:09.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:10.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:10.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:10.409 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:10.409+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:11.160 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:11.160+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:11.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:11.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:12.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:12.202+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:12.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:12.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:13.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:13.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:13.523 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:13.522+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:14.210 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:14.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:14.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:14.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:15.197 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:15.196+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:15.481 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:15.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:16.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:16.183+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:16.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:16.485+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:17.203 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:17.202+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:17.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:17.447+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:18.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:18.217+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:18.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:18.465+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:19.222 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:19.221+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:19.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:19.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:20.224 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:20.224+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:20.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:20.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:21.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:21.207+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:21.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:21.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:22.252 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:22.251+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:22.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:22.392+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:23.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:23.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:23.440 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:23.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:24.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:24.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:24.394 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:24.393+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:25.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:25.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:25.369 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:25.368+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:26.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:26.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:26.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:26.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:27.334 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:27.330+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:27.418 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:27.417+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:28.283 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:28.282+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:28.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:28.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:29.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:29.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:29.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:29.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:30.362 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:30.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:30.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:30.462+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:31.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:31.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:31.458 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:31.457+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:32.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:32.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:32.464 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:32.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:33.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:33.244+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:33.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:33.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:34.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:34.247+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:34.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:34.460+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:35.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:35.270+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:35.454 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:35.453+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:36.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:36.304+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:36.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:36.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:37.277 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:37.276+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:37.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:37.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:38.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:38.310+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:38.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:38.345+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:39.292 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:39.292+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:39.319 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:39.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:40.299 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:40.299+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:40.331 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:40.331+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:41.312 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:41.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:41.344 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:41.344+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:42.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:42.336+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:42.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:42.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:43.306 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:43.306+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:43.364 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:43.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:44.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:44.261+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:44.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:44.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:45.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:45.254+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:45.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:45.379+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:46.271 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:46.270+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:46.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:46.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:47.297 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:47.297+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:47.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:47.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:48.259 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:48.260+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:48.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:48.402+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:49.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:49.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:49.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:49.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:50.231 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:50.230+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:50.374 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:50.373+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:51.231 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:51.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:51.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:51.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:52.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:52.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:52.414 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:52.413+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:53.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:53.283+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:53.391 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:53.390+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:54.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:54.271+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:54.388 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:54.387+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:55.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:55.249+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:55.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:55.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:56.254 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:56.254+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:56.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:56.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:57.264 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:57.263+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:57.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:57.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:58.240 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:58.239+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:58.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:58.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:59.270 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:10:59.269+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:10:59.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:10:59.428+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:00.286 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:00.285+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:00.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:00.443+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:01.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:01.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:01.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:01.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:02.239 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:02.239+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:02.518 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:02.518+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:03.287 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:03.286+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:03.485 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:03.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:04.312 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:04.311+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:04.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:04.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:05.332 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:05.332+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:05.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:05.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:06.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:06.319+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:06.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:06.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:07.302 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:07.301+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:07.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:07.558+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:08.326 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:08.325+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:08.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:08.568+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:09.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:09.289+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:09.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:09.570+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:10.279 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:10.278+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:10.551 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:10.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:11.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:11.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:11.554 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:11.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:12.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:12.243+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:12.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:12.513+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:13.195 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:13.194+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:13.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:13.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:14.148 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:14.147+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:14.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:14.521+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:15.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:15.123+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:15.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:15.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:16.142 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:16.141+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:16.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:16.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:17.180 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:17.179+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:17.459 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:17.458+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:18.132 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:18.131+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:18.491 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:18.490+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:19.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:19.089+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:19.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:19.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:20.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:20.109+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:20.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:20.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:21.104 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:21.103+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:21.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:21.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:22.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:22.083+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:22.509 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:22.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:23.090 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:23.089+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:23.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:23.555+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:24.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:24.083+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:24.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:24.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:25.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:25.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:25.581 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:25.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:26.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:26.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:26.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:26.616+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:27.014 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:27.014+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:27.640 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:27.640+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:28.060 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:28.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:28.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:28.609+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:29.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:29.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:29.588 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:29.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:30.023 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:30.023+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:30.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:30.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:31.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:31.000+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:31.573 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:31.573+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:32.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:32.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:32.586 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:32.587+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:33.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:33.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:33.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:33.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:34.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:34.041+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:34.618 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:34.617+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:35.082 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:35.081+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:35.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:35.571+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:36.070 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:36.069+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:36.590 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:36.589+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:37.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:37.034+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:37.558 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:37.557+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:38.062 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:38.061+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:38.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:38.554+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:39.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:39.021+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:39.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:39.603+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:40.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:40.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:40.579 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:40.578+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:40.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:40.957+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:41.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:41.546+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:41.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:41.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:42.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:42.534+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:42.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:42.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:43.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:43.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:43.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:43.890+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:44.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:44.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:44.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:44.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:45.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:45.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:45.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:45.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:46.557 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:46.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:46.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:46.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:47.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:47.538+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:47.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:47.900+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:48.563 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:48.562+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:48.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:48.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:49.594 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:49.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:49.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:49.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:50.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:50.623+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:50.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:50.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:51.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:51.612+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:51.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:51.929+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:52.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:52.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:52.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:52.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:53.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:53.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:53.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:53.962+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:54.622 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:54.621+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:54.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:54.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:55.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:55.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:56.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:56.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:56.599 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:56.598+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:56.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:56.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:57.623 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:57.622+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:57.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:57.940+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:58.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:58.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:58.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:58.908+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:59.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:11:59.559+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:11:59.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:11:59.900+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:00.567 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:00.566+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:00.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:00.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:01.541 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:01.540+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:01.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:01.912+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:02.566 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:02.565+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:02.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:02.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:03.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:03.528+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:03.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:03.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:04.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:04.535+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:04.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:04.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:05.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:05.518+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:05.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:05.996+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:06.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:06.531+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:07.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:07.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:07.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:07.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:07.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:07.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:08.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:08.550+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:09.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:09.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:09.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:09.519+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:09.979 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:09.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:10.473 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:10.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:10.964 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:10.963+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:11.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:11.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:11.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:11.975+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:12.483 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:12.484+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:12.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:12.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:13.435 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:13.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:14.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:14.001+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:14.471 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:14.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:15.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:15.044+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:15.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:15.472+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:16.067 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:16.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:16.503 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:16.503+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:17.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:17.019+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:17.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:17.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:18.001 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:18.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:18.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:18.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:18.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:18.957+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:19.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:19.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:19.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:19.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:20.504 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:20.504+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:20.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:20.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:21.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:21.495+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:21.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:21.912+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:22.543 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:22.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:22.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:22.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:23.549 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:23.548+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:23.867 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:23.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:24.519 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:24.519+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:24.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:24.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:25.498 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:25.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:25.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:25.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:26.546 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:26.545+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:26.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:26.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:27.582 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:27.581+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:27.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:27.915+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:28.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:28.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:28.942 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:28.942+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:29.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:29.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:29.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:29.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:30.510 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:30.509+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:30.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:30.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:31.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:31.523+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:31.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:31.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:32.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:32.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:32.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:32.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:33.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:33.496+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:33.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:33.898+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:34.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:34.499+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:34.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:34.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:35.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:35.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:35.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:35.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:36.492 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:36.491+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:36.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:36.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:37.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:37.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:37.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:37.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:38.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:38.541+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:38.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:38.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:39.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:39.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:39.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:39.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:40.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:40.470+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:40.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:40.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:41.456 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:41.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:41.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:41.928+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:42.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:42.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:42.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:42.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:43.425 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:43.424+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:43.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:43.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:44.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:44.385+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:44.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:44.858+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:45.387 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:45.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:45.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:45.902+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:46.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:46.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:46.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:46.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:47.402 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:47.401+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:47.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:47.917+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:48.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:48.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:48.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:48.967+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:49.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:49.404+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:49.940 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:49.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:50.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:50.444+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:50.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:50.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:51.467 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:51.467+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:51.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:51.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:52.448 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:52.448+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:52.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:52.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:53.411 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:53.411+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:53.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:53.904+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:54.423 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:54.423+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:54.900 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:54.899+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:55.376 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:55.375+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:55.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:55.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:56.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:56.376+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:56.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:56.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:57.366 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:57.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:57.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:57.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:58.395 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:58.395+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:58.955 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:58.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:59.434 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:12:59.434+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:12:59.907 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:12:59.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:00.469 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:00.469+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:00.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:00.879+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:01.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:01.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:01.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:01.923+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:02.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:02.481+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:02.924 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:02.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:03.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:03.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:03.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:03.877+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:04.474 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:04.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:04.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:04.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:05.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:05.462+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:05.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:05.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:06.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:06.508+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:06.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:06.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:07.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:07.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:07.864 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:07.863+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:08.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:08.493+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:08.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:08.885+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:09.472 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:09.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:09.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:09.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:10.465 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:10.464+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:10.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:10.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:11.506 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:11.505+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:11.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:11.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:12.508 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:12.507+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:12.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:12.859+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:13.461 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:13.460+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:13.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:13.840+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:14.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:14.462+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:14.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:14.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:15.490 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:15.489+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:15.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:15.819+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:16.521 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:16.520+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:16.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:16.829+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:17.545 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:17.544+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:17.812 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:17.811+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:18.550 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:18.549+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:18.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:18.856+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:19.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:19.510+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:19.865 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:19.864+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:20.542 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:20.542+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:20.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:20.831+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:21.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:21.512+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:21.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:21.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:22.537 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:22.536+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:22.788 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:22.787+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:23.516 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:23.515+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:23.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:23.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:24.548 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:24.547+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:24.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:24.790+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:25.556 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:25.556+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:25.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:25.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:26.538 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:26.537+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:26.800 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:26.799+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:27.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:27.554+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:27.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:27.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:28.595 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:28.594+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:28.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:28.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:29.589 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:29.588+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:29.852 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:29.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:30.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:30.631+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:30.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:30.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:31.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:31.668+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:31.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:31.873+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:32.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:32.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:32.880 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:32.879+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:33.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:33.749+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:33.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:33.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:34.753 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:34.752+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:34.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:34.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:35.754 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:35.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:35.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:35.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:36.725 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:36.724+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:36.882 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:36.881+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:37.749 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:37.747+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:37.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:37.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:38.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:38.781+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:38.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:38.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:39.759 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:39.758+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:39.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:39.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:40.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:40.809+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:40.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:40.935+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:41.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:41.801+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:41.929 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:41.928+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:42.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:42.824+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:42.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:42.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:43.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:43.834+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:43.948 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:43.948+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:44.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:44.792+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:44.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:44.958+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:45.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:45.802+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:45.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:45.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:46.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:46.818+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:46.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:46.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:47.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:47.790+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:47.901 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:47.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:48.817 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:48.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:48.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:48.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:49.774 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:49.774+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:49.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:49.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:50.791 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:50.791+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:50.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:50.923+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:51.810 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:51.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:51.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:51.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:52.832 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:52.831+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:52.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:52.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:53.838 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:53.837+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:53.912 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:53.911+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:54.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:54.876+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:54.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:54.882+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:55.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:55.898+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:55.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:55.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:56.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:56.864+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:56.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:56.908+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:57.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:57.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:57.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:57.902+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:58.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:58.844+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:58.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:58.948+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:59.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:13:59.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:13:59.977 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:13:59.976+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:00.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:00.836+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:00.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:00.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:01.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:01.817+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:02.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:02.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:02.797 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:02.796+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:02.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:02.960+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:03.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:03.770+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:03.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:03.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:04.762 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:04.761+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:04.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:04.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:05.741 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:05.740+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:06.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:06.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:06.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:06.763+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:07.012 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:07.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:07.811 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:07.810+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:08.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:08.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:08.788 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:08.787+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:09.073 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:09.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:09.750 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:09.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:10.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:10.024+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:10.743 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:10.742+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:11.055 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:11.054+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:11.771 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:11.770+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:12.061 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:12.060+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:12.755 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:12.754+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:13.068 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:13.067+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:13.756 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:13.755+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:14.069 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:14.068+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:14.790 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:14.789+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:15.099 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:15.098+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:15.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:15.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:16.079 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:16.078+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:16.782 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:16.781+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:17.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:17.070+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:17.808 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:17.807+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:18.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:18.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:18.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:18.824+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:19.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:18.999+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:19.823 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:19.823+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:19.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:19.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:20.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:20.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:20.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:20.962+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:21.836 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:21.835+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:21.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:21.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:22.815 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:22.814+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:22.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:22.933+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:23.802 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:23.801+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:23.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:23.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:24.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:24.847+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:24.971 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:24.970+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:25.840 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:25.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:25.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:25.948+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:26.884 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:26.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:26.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:26.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:27.855 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:27.854+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:27.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:27.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:28.877 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:28.877+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:28.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:28.957+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:29.828 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:29.828+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:29.922 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:29.923+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:30.856 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:30.856+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:30.947 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:30.947+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:31.818 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:31.819+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:31.975 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:31.975+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:32.859 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:32.859+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:32.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:32.980+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:33.825 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:33.825+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:33.943 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:33.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:34.874 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:34.875+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:34.965 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:34.965+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:35.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:35.907+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:35.920 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:35.920+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:36.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:36.886+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:36.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:36.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:37.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:37.871+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:37.888 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:37.887+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:38.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:38.894+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:38.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:38.918+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:39.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:39.939+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:39.940 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:39.940+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:40.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:40.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:40.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:40.914+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:41.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:41.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:41.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:41.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:42.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:42.809+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:42.918 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:42.917+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:43.856 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:43.855+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:43.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:43.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:44.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:44.884+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:44.922 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:44.922+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:45.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:45.868+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:45.964 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:45.964+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:46.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:46.877+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:46.973 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:46.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:47.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:47.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:47.977 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:47.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:48.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:48.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:48.980 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:48.979+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:49.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:49.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:50.003 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:50.003+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:50.889 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:50.888+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:51.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:51.032+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:51.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:51.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:52.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:52.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:52.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:52.894+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:53.045 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:53.044+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:53.937 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:53.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:54.095 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:54.094+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:54.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:54.945+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:55.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:55.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:55.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:55.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:56.113 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:56.112+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:56.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:56.914+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:57.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:57.141+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:57.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:57.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:58.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:58.128+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:58.915 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:58.914+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:59.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:14:59.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:14:59.923 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:14:59.922+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:00.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:00.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:00.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:00.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:01.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:01.147+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:01.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:01.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:02.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:02.143+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:02.925 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:02.924+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:03.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:03.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:03.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:03.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:04.075 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:04.074+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:04.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:04.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:05.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:05.075+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:05.840 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:05.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:06.033 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:06.032+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:06.821 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:06.820+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:07.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:07.056+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:07.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:07.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:08.014 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:08.013+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:08.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:08.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:09.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:09.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:09.796 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:09.795+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:10.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:10.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:10.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:10.817+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:11.051 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:11.050+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:11.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:11.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:12.006 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:12.005+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:12.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:12.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:12.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:12.988+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:13.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:13.831+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:14.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:14.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:14.879 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:14.879+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:14.989 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:14.989+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:15.885 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:15.885+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:15.999 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:16.000+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:16.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:16.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:16.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:16.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:17.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:17.804+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:18.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:18.005+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:18.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:18.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:18.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:18.971+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:19.782 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:19.782+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:19.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:19.998+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:20.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:20.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:20.961 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:20.962+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:21.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:21.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:22.002 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:22.002+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:22.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:22.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:22.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:22.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:23.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:23.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:23.939 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:23.939+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:24.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:24.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:24.948 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:24.947+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:25.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:25.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:25.967 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:25.966+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:26.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:26.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:26.952 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:26.951+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:27.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:27.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:27.986 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:27.986+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:28.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:28.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:28.984 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:28.983+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:29.951 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:29.950+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:29.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:29.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:30.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:30.935+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:30.943 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:30.943+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:31.906 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:31.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:31.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:31.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:32.921 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:32.920+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:32.949 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:32.948+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:33.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:33.931+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:33.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:33.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:34.975 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:34.975+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:35.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:35.001+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:35.985 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:35.984+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:36.006 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:36.006+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:36.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:36.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:37.021 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:37.020+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:37.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:37.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:38.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:38.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:38.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:38.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:39.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:39.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:39.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:39.971+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:39.988 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:39.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:40.958 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:40.957+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:41.031 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:41.030+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:41.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:41.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:41.987 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:41.987+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:42.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:42.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:42.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:42.967+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:43.895 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:43.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:43.930 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:43.929+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:44.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:44.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:44.946 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:44.945+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:45.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:45.896+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:45.938 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:45.937+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:46.902 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:46.901+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:46.909 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:46.909+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:47.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:47.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:47.910 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:47.910+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:48.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:48.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:48.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:48.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:49.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:49.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:49.962 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:49.961+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:50.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:50.871+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:50.992 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:50.991+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:51.881 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:51.880+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:52.016 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:52.015+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:52.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:52.835+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:53.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:53.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:53.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:53.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:54.079 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:54.078+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:54.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:54.826+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:55.068 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:55.068+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:55.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:55.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:56.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:56.070+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:56.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:56.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:57.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:57.117+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:57.835 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:57.834+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:58.076 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:58.075+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:58.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:58.785+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:59.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:15:59.105+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:15:59.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:15:59.773+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:00.156 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:00.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:00.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:00.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:01.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:01.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:01.724 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:01.725+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:02.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:02.203+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:02.685 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:02.685+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:03.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:03.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:03.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:03.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:04.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:04.222+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:04.707 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:04.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:05.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:05.198+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:05.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:05.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:06.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:06.210+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:06.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:06.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:07.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:07.178+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:07.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:07.807+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:08.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:08.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:08.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:08.831+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:09.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:09.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:09.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:09.845+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:10.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:10.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:10.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:10.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:11.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:11.278+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:11.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:11.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:12.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:12.294+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:12.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:12.866+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:13.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:13.281+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:13.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:13.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:14.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:14.328+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:14.836 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:14.835+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:15.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:15.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:15.795 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:15.794+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:16.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:16.331+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:16.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:16.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:17.371 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:17.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:17.772 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:17.771+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:18.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:18.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:18.794 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:18.793+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:19.377 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:19.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:19.781 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:19.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:20.345 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:20.344+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:20.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:20.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:21.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:21.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:21.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:21.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:22.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:22.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:22.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:22.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:23.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:23.319+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:23.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:23.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:24.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:24.275+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:24.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:24.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:25.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:25.294+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:25.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:25.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:26.321 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:26.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:26.813 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:26.812+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:27.336 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:27.336+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:27.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:27.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:28.332 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:28.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:28.872 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:28.871+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:29.359 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:29.358+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:29.833 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:29.833+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:30.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:30.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:30.837 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:30.836+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:31.300 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:31.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:31.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:31.846+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:32.324 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:32.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:32.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:32.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:33.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:33.317+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:33.862 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:33.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:34.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:34.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:34.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:34.830+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:35.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:35.332+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:35.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:35.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:36.383 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:36.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:36.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:36.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:37.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:37.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:37.809 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:37.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:38.416 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:38.415+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:38.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:38.801+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:39.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:39.381+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:39.816 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:39.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:40.401 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:40.400+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:40.853 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:40.852+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:41.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:41.418+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:41.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:41.851+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:42.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:42.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:42.818 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:42.818+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:43.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:43.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:43.854 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:43.853+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:44.405 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:44.405+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:44.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:44.819+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:45.408 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:45.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:45.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:45.819+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:46.396 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:46.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:46.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:46.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:47.439 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:47.439+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:47.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:47.855+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:48.426 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:48.426+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:48.825 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:48.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:49.433 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:49.433+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:49.868 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:49.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:50.393 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:50.394+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:50.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:50.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:51.410 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:51.410+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:51.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:51.905+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:52.383 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:52.383+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:52.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:52.917+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:53.384 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:53.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:53.897 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:53.897+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:54.360 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:54.360+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:54.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:54.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:55.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:55.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:55.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:55.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:56.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:56.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:56.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:56.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:57.320 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:57.320+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:57.875 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:57.875+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:58.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:58.343+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:58.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:58.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:59.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:16:59.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:16:59.918 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:16:59.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:00.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:00.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:00.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:00.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:01.272 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:01.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:01.849 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:01.847+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:02.243 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:02.242+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:02.810 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:02.810+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:03.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:03.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:03.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:03.806+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:04.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:04.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:04.785 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:04.784+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:05.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:05.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:05.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:05.819+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:06.294 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:06.294+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:06.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:06.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:07.335 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:07.334+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:07.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:07.841+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:08.347 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:08.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:08.822 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:08.821+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:09.301 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:09.300+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:09.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:09.782+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:10.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:10.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:10.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:10.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:11.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:11.272+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:11.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:11.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:12.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:12.229+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:12.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:12.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:13.246 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:13.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:13.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:13.803+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:14.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:14.239+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:14.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:14.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:15.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:15.257+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:15.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:15.885+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:16.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:16.236+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:16.916 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:16.915+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:17.278 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:17.277+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:17.876 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:17.876+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:18.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:18.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:18.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:18.914+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:19.310 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:19.309+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:19.908 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:19.907+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:20.275 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:20.274+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:20.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:20.885+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:21.288 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:21.287+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:21.914 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:21.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:22.271 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:22.270+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:22.888 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:22.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:23.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:23.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:23.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:23.856+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:24.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:24.215+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:24.841 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:24.841+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:25.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:25.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:25.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:25.819+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:26.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:26.143+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:26.819 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:26.818+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:27.194 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:27.193+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:27.774 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:27.773+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:28.245 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:28.244+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:28.757 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:28.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:29.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:29.215+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:29.730 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:29.729+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:30.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:30.180+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:30.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:30.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:31.228 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:31.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:31.773 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:31.772+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:32.254 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:32.254+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:32.763 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:32.763+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:33.299 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:33.299+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:33.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:33.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:34.256 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:34.256+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:34.696 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:34.697+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:35.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:35.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:35.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:35.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:36.239 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:36.239+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:36.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:36.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:37.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:37.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:37.711 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:37.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:38.197 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:38.198+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:38.696 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:38.697+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:39.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:39.189+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:39.740 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:39.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:40.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:40.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:40.728 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:40.728+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:41.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:41.182+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:41.561 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-28T16:17:41.561 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T16:17:41.561+0000 7fcd5affd700 -1 Fail to read '/proc/92773/cmdline' error = (3) No such process 2023-09-28T16:17:41.562 INFO:tasks.workunit.client.0.smithi069.stderr:2023-09-28T16:17:41.561+0000 7fcd5affd700 -1 received signal: Terminated from (PID: 92773) UID: 1000 2023-09-28T16:17:41.750 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:41.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:42.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:42.186+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:42.725 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:42.724+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:43.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:43.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:43.752 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:43.751+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:44.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:44.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:44.725 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:44.724+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:45.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:45.198+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:45.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:45.711+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:46.209 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:46.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:46.697 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:46.696+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:47.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:47.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:47.661 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:47.660+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:48.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:48.244+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:48.661 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:48.661+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:49.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:49.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:49.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:49.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:50.188 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:50.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:50.585 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:50.585+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:51.199 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:51.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:51.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:51.633+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:52.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:52.189+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:52.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:52.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:53.227 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:53.226+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:53.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:53.596+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:54.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:54.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:54.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:54.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:55.198 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:55.197+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:55.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:55.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:56.228 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:56.227+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:56.624 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:56.623+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:57.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:57.215+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:57.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:57.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:58.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:58.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:58.598 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:58.597+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:59.171 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:17:59.170+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:17:59.633 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:17:59.632+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:00.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:00.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:00.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:00.666+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:01.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:01.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:01.716 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:01.715+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:02.240 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:02.239+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:02.691 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:02.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:03.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:03.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:03.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:03.672+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:04.168 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:04.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:04.676 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:04.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:05.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:05.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:05.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:05.665+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:06.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:06.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:06.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:06.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:07.112 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:07.112+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:07.656 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:07.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:08.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:08.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:08.706 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:08.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:09.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:09.107+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:09.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:09.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:10.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:10.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:10.751 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:10.750+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:11.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:11.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:11.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:11.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:12.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:12.210+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:12.725 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:12.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:13.191 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:13.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:13.766 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:13.765+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:14.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:14.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:14.758 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:14.758+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:15.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:15.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:15.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:15.760+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:16.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:16.160+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:16.727 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:16.726+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:17.116 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:17.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:17.734 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:17.734+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:18.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:18.076+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:18.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:18.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:19.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:19.108+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:19.786 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:19.786+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:20.121 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:20.121+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:20.784 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:20.785+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:21.082 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:21.082+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:21.805 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:21.805+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:22.036 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:22.036+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:22.850 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:22.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:23.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:23.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:23.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:23.867+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:24.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:24.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:24.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:24.846+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:25.086 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:25.082+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:25.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:25.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:26.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:26.056+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:26.838 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:26.839+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:27.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:27.057+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:27.884 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:27.883+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:28.012 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:28.012+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:28.839 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:28.838+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:29.017 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:29.016+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:29.797 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:29.796+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:30.062 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:30.062+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:30.847 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:30.846+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:31.104 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:31.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:31.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:31.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:32.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:32.135+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:32.783 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:32.783+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:33.114 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:33.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:33.742 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:33.741+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:34.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:34.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:34.695 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:34.694+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:35.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:35.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:35.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:35.654+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:36.192 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:36.191+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:36.673 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:36.672+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:37.168 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:37.168+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:37.635 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:37.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:38.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:38.161+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:38.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:38.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:39.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:39.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:39.625 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:39.624+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:40.172 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:40.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:40.630 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:40.630+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:41.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:41.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:41.562 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-09-28T16:18:41.587 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:41.586+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:42.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:42.168+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:42.581 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:42.580+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:43.185 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:43.184+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:43.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:43.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:44.158 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:44.158+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:44.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:44.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:45.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:45.146+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:45.578 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:45.578+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:46.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:46.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:46.621 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:46.620+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:47.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:47.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:47.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:47.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:48.131 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:48.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:48.588 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:48.588+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:49.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:49.176+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:49.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:49.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:50.190 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:50.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:50.647 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:50.646+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:51.154 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:51.154+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:51.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:51.600+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:52.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:52.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:52.610 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:52.610+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:53.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:53.174+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:53.612 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:53.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:54.172 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:54.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:54.618 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:54.617+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:55.163 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:55.162+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:55.648 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:55.647+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:56.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:56.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:56.654 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:56.653+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:57.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:57.206+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:57.651 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:57.650+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:58.236 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:58.235+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:58.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:58.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:59.281 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:18:59.281+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:18:59.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:18:59.602+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:00.303 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:00.302+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:00.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:00.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:01.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:01.306+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:01.575 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:01.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:02.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:02.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:02.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:02.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:03.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:03.307+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:03.571 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:03.570+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:04.263 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:04.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:04.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:04.550+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:05.276 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:05.276+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:05.535 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:05.535+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:06.229 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:06.229+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:06.536 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:06.536+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:07.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:07.217+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:07.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:07.532+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:08.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:08.253+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:08.513 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:08.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:09.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:09.214+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:09.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:09.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:10.237 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:10.237+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:10.551 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:10.552+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:11.208 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:11.208+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:11.533 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:11.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:12.216 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:12.216+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:12.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:12.562+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:13.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:13.181+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:13.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:13.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:14.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:14.152+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:14.592 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:14.591+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:15.140 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:15.140+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:15.546 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:15.545+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:16.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:16.119+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:16.547 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:16.518+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:17.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:17.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:17.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:17.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:18.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:18.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:18.464 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:18.463+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:19.117 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:19.116+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:19.487 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:19.486+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:20.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:20.132+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:20.510 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:20.509+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:21.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:21.114+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:21.516 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:21.516+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:22.144 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:22.144+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:22.481 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:22.480+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:23.097 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:23.096+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:23.461 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:23.460+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:24.055 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:24.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:24.440 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:24.439+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:25.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:25.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:25.476 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:25.475+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:26.000 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:25.999+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:26.457 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:26.456+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:27.009 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:27.008+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:27.444 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:27.443+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:28.029 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:28.028+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:28.432 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:28.431+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:29.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:29.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:29.401 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:29.400+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:30.027 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:30.026+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:30.357 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:30.357+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:31.007 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:31.006+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:31.313 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:31.312+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:31.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:31.996+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:32.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:32.341+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:33.042 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:33.041+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:33.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:33.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:34.032 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:34.032+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:34.347 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:34.346+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:35.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:35.024+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:35.351 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:35.350+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:36.019 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:36.018+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:36.369 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:36.368+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:36.998 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:36.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:37.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:37.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:38.041 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:38.040+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:38.356 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:38.355+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:39.052 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:39.051+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:39.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:39.386+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:40.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:40.069+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:40.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:40.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:41.110 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:41.109+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:41.320 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:41.320+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:41.562 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-09-28T16:19:41.563 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2023-09-28T16:19:41.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-09-28T16:19:41.851 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi069 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2c186684db7f9ea0cdb098fc86b350a0fdd26eba TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-09-28T16:19:41.915 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a3decacfff8140dc981cd91ce67dfd14 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_2c186684db7f9ea0cdb098fc86b350a0fdd26eba/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi069 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2c186684db7f9ea0cdb098fc86b350a0fdd26eba TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-09-28T16:19:41.917 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-28T16:19:41.926 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-28T16:19:41.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T16:19:42.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:42.142+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:42.255 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:19:42.256 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":160,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T14:19:57.192988+0000","last_up_change":"2023-09-28T13:16:36.467615+0000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T13:16:38.484517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T13:16:42.162780+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":92,"snap_epoch":157,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-09-28T13:16:49.437179+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":92,"snap_epoch":157,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":86628},{"type":"v1","addr":"172.21.15.69:6817","nonce":86628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":86628},{"type":"v1","addr":"172.21.15.69:6819","nonce":86628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":86628},{"type":"v1","addr":"172.21.15.69:6823","nonce":86628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":86628},{"type":"v1","addr":"172.21.15.69:6821","nonce":86628}]},"public_addr":"172.21.15.69:6817/86628","cluster_addr":"172.21.15.69:6819/86628","heartbeat_back_addr":"172.21.15.69:6823/86628","heartbeat_front_addr":"172.21.15.69:6821/86628","state":["exists","up"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":86604},{"type":"v1","addr":"172.21.15.69:6801","nonce":86604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":86604},{"type":"v1","addr":"172.21.15.69:6803","nonce":86604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":86604},{"type":"v1","addr":"172.21.15.69:6807","nonce":86604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":86604},{"type":"v1","addr":"172.21.15.69:6805","nonce":86604}]},"public_addr":"172.21.15.69:6801/86604","cluster_addr":"172.21.15.69:6803/86604","heartbeat_back_addr":"172.21.15.69:6807/86604","heartbeat_front_addr":"172.21.15.69:6805/86604","state":["exists","up"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":86605},{"type":"v1","addr":"172.21.15.69:6809","nonce":86605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":86605},{"type":"v1","addr":"172.21.15.69:6811","nonce":86605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":86605},{"type":"v1","addr":"172.21.15.69:6815","nonce":86605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":86605},{"type":"v1","addr":"172.21.15.69:6813","nonce":86605}]},"public_addr":"172.21.15.69:6809/86605","cluster_addr":"172.21.15.69:6811/86605","heartbeat_back_addr":"172.21.15.69:6815/86605","heartbeat_front_addr":"172.21.15.69:6813/86605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.888190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.815570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.891847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T16:19:42.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T16:19:42.270 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:19:42.324 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:42.323+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:42.583 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:19:42.584 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:19:42.596 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5650,"stamp":"2023-09-28T16:19:42.139571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26821,"ondisk_log_size":26821,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":681348,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":176640,"kb_avail":282434172,"statfs":{"total":289910292480,"available":289212592128,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180879360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001835"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"158'1680","reported_seq":2614,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193412+0000","last_change":"2023-09-28T13:21:19.921744+0000","last_active":"2023-09-28T14:19:27.193412+0000","last_peered":"2023-09-28T14:19:27.193412+0000","last_clean":"2023-09-28T14:19:27.193412+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T14:19:27.193412+0000","last_undegraded":"2023-09-28T14:19:27.193412+0000","last_fullsized":"2023-09-28T14:19:27.193412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1680,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:25:43.877047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"158'1063","reported_seq":1972,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193704+0000","last_change":"2023-09-28T13:21:19.921823+0000","last_active":"2023-09-28T14:19:27.193704+0000","last_peered":"2023-09-28T14:19:27.193704+0000","last_clean":"2023-09-28T14:19:27.193704+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T14:19:27.193704+0000","last_undegraded":"2023-09-28T14:19:27.193704+0000","last_fullsized":"2023-09-28T14:19:27.193704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1063,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:32:03.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9253,"ondisk_log_size":9253,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254660,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":71296,"kb_avail":94117180,"statfs":{"total":96636764160,"available":96375992320,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73007104},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.20899999999999999,"5min":0.223,"15min":0.22600000000000001},"min":{"1min":0.158,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.35899999999999999,"5min":0.443,"15min":0.46100000000000002},"last":0.25},{"interface":"front","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.26800000000000002},"min":{"1min":0.193,"5min":0.17399999999999999,"15min":0.156},"max":{"1min":0.45600000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23699999999999999,"15min":0.24099999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.158},"max":{"1min":0.33800000000000002,"5min":0.497,"15min":0.497},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.20599999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41499999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.28999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740570,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.215,"15min":0.219},"min":{"1min":0.17199999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.42699999999999999},"last":0.224},{"interface":"front","average":{"1min":0.221,"5min":0.22800000000000001,"15min":0.23100000000000001},"min":{"1min":0.17999999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.35599999999999998,"5min":0.44,"15min":0.45600000000000002},"last":0.23599999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.24299999999999999,"15min":0.248},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.38100000000000001,"5min":0.45800000000000002,"15min":0.47799999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.255,"5min":0.25700000000000001,"15min":0.26000000000000001},"min":{"1min":0.20699999999999999,"5min":0.19500000000000001,"15min":0.17699999999999999},"max":{"1min":0.39200000000000002,"5min":0.47499999999999998,"15min":0.55000000000000004},"last":0.19600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740573,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245360,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94126480,"statfs":{"total":96636764160,"available":96385515520,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.214,"15min":0.214},"min":{"1min":0.16500000000000001,"5min":0.13900000000000001,"15min":0.13500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.221},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.17199999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Sep 28 16:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23000000000000001,"15min":0.23300000000000001},"min":{"1min":0.16400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.443,"5min":0.443,"15min":0.45200000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26400000000000001,"15min":0.26300000000000001},"min":{"1min":0.188,"5min":0.184,"15min":0.184},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"last":0.29999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:19:42.597 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:19:42.911 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:19:42.913 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:19:42.926 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5650,"stamp":"2023-09-28T16:19:42.139571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26821,"ondisk_log_size":26821,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":681348,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":176640,"kb_avail":282434172,"statfs":{"total":289910292480,"available":289212592128,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180879360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001835"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"158'1680","reported_seq":2614,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193412+0000","last_change":"2023-09-28T13:21:19.921744+0000","last_active":"2023-09-28T14:19:27.193412+0000","last_peered":"2023-09-28T14:19:27.193412+0000","last_clean":"2023-09-28T14:19:27.193412+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T14:19:27.193412+0000","last_undegraded":"2023-09-28T14:19:27.193412+0000","last_fullsized":"2023-09-28T14:19:27.193412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1680,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:25:43.877047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"158'1063","reported_seq":1972,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193704+0000","last_change":"2023-09-28T13:21:19.921823+0000","last_active":"2023-09-28T14:19:27.193704+0000","last_peered":"2023-09-28T14:19:27.193704+0000","last_clean":"2023-09-28T14:19:27.193704+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T14:19:27.193704+0000","last_undegraded":"2023-09-28T14:19:27.193704+0000","last_fullsized":"2023-09-28T14:19:27.193704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1063,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:32:03.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9253,"ondisk_log_size":9253,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254660,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":71296,"kb_avail":94117180,"statfs":{"total":96636764160,"available":96375992320,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73007104},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.20899999999999999,"5min":0.223,"15min":0.22600000000000001},"min":{"1min":0.158,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.35899999999999999,"5min":0.443,"15min":0.46100000000000002},"last":0.25},{"interface":"front","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.26800000000000002},"min":{"1min":0.193,"5min":0.17399999999999999,"15min":0.156},"max":{"1min":0.45600000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23699999999999999,"15min":0.24099999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.158},"max":{"1min":0.33800000000000002,"5min":0.497,"15min":0.497},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.20599999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41499999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.28999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740570,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.215,"15min":0.219},"min":{"1min":0.17199999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.42699999999999999},"last":0.224},{"interface":"front","average":{"1min":0.221,"5min":0.22800000000000001,"15min":0.23100000000000001},"min":{"1min":0.17999999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.35599999999999998,"5min":0.44,"15min":0.45600000000000002},"last":0.23599999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.24299999999999999,"15min":0.248},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.38100000000000001,"5min":0.45800000000000002,"15min":0.47799999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.255,"5min":0.25700000000000001,"15min":0.26000000000000001},"min":{"1min":0.20699999999999999,"5min":0.19500000000000001,"15min":0.17699999999999999},"max":{"1min":0.39200000000000002,"5min":0.47499999999999998,"15min":0.55000000000000004},"last":0.19600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740573,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245360,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94126480,"statfs":{"total":96636764160,"available":96385515520,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.214,"15min":0.214},"min":{"1min":0.16500000000000001,"5min":0.13900000000000001,"15min":0.13500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.221},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.17199999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Sep 28 16:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23000000000000001,"15min":0.23300000000000001},"min":{"1min":0.16400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.443,"5min":0.443,"15min":0.45200000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26400000000000001,"15min":0.26300000000000001},"min":{"1min":0.188,"5min":0.184,"15min":0.184},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"last":0.29999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:19:42.927 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T16:19:42.928 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:19:43.100 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:43.099+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:43.241 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:19:43.243 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:19:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5650,"stamp":"2023-09-28T16:19:42.139571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26821,"ondisk_log_size":26821,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":681348,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":176640,"kb_avail":282434172,"statfs":{"total":289910292480,"available":289212592128,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180879360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001835"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"158'1680","reported_seq":2614,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193412+0000","last_change":"2023-09-28T13:21:19.921744+0000","last_active":"2023-09-28T14:19:27.193412+0000","last_peered":"2023-09-28T14:19:27.193412+0000","last_clean":"2023-09-28T14:19:27.193412+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T14:19:27.193412+0000","last_undegraded":"2023-09-28T14:19:27.193412+0000","last_fullsized":"2023-09-28T14:19:27.193412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1680,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:25:43.877047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"158'1063","reported_seq":1972,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193704+0000","last_change":"2023-09-28T13:21:19.921823+0000","last_active":"2023-09-28T14:19:27.193704+0000","last_peered":"2023-09-28T14:19:27.193704+0000","last_clean":"2023-09-28T14:19:27.193704+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T14:19:27.193704+0000","last_undegraded":"2023-09-28T14:19:27.193704+0000","last_fullsized":"2023-09-28T14:19:27.193704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1063,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:32:03.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9253,"ondisk_log_size":9253,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254660,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":71296,"kb_avail":94117180,"statfs":{"total":96636764160,"available":96375992320,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73007104},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.20899999999999999,"5min":0.223,"15min":0.22600000000000001},"min":{"1min":0.158,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.35899999999999999,"5min":0.443,"15min":0.46100000000000002},"last":0.25},{"interface":"front","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.26800000000000002},"min":{"1min":0.193,"5min":0.17399999999999999,"15min":0.156},"max":{"1min":0.45600000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23699999999999999,"15min":0.24099999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.158},"max":{"1min":0.33800000000000002,"5min":0.497,"15min":0.497},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.20599999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41499999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.28999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740570,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.215,"15min":0.219},"min":{"1min":0.17199999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.42699999999999999},"last":0.224},{"interface":"front","average":{"1min":0.221,"5min":0.22800000000000001,"15min":0.23100000000000001},"min":{"1min":0.17999999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.35599999999999998,"5min":0.44,"15min":0.45600000000000002},"last":0.23599999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.24299999999999999,"15min":0.248},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.38100000000000001,"5min":0.45800000000000002,"15min":0.47799999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.255,"5min":0.25700000000000001,"15min":0.26000000000000001},"min":{"1min":0.20699999999999999,"5min":0.19500000000000001,"15min":0.17699999999999999},"max":{"1min":0.39200000000000002,"5min":0.47499999999999998,"15min":0.55000000000000004},"last":0.19600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740573,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245360,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94126480,"statfs":{"total":96636764160,"available":96385515520,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.214,"15min":0.214},"min":{"1min":0.16500000000000001,"5min":0.13900000000000001,"15min":0.13500000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.221},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.17199999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Sep 28 16:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.23000000000000001,"15min":0.23300000000000001},"min":{"1min":0.16400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.443,"5min":0.443,"15min":0.45200000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26400000000000001,"15min":0.26300000000000001},"min":{"1min":0.188,"5min":0.184,"15min":0.184},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48999999999999999},"last":0.29999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:19:43.256 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T16:19:43.288 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:43.287+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:43.573 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:19:43.574 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":160,"fsid":"aea3e571-5f08-4258-b80b-a913c1bdff4d","created":"2023-09-28T13:16:26.728497+0000","modified":"2023-09-28T14:19:57.192988+0000","last_up_change":"2023-09-28T13:16:36.467615+0000","last_in_change":"2023-09-28T13:16:27.695585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T13:16:38.484517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T13:16:42.162780+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":92,"snap_epoch":157,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-09-28T13:16:49.437179+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":92,"snap_epoch":157,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b96f86a3-12d6-49d3-9473-54ade67387c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":86628},{"type":"v1","addr":"172.21.15.69:6817","nonce":86628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":86628},{"type":"v1","addr":"172.21.15.69:6819","nonce":86628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":86628},{"type":"v1","addr":"172.21.15.69:6823","nonce":86628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":86628},{"type":"v1","addr":"172.21.15.69:6821","nonce":86628}]},"public_addr":"172.21.15.69:6817/86628","cluster_addr":"172.21.15.69:6819/86628","heartbeat_back_addr":"172.21.15.69:6823/86628","heartbeat_front_addr":"172.21.15.69:6821/86628","state":["exists","up"]},{"osd":1,"uuid":"7e69c7d9-132c-49cf-951d-75df98e19410","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":86604},{"type":"v1","addr":"172.21.15.69:6801","nonce":86604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":86604},{"type":"v1","addr":"172.21.15.69:6803","nonce":86604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":86604},{"type":"v1","addr":"172.21.15.69:6807","nonce":86604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":86604},{"type":"v1","addr":"172.21.15.69:6805","nonce":86604}]},"public_addr":"172.21.15.69:6801/86604","cluster_addr":"172.21.15.69:6803/86604","heartbeat_back_addr":"172.21.15.69:6807/86604","heartbeat_front_addr":"172.21.15.69:6805/86604","state":["exists","up"]},{"osd":2,"uuid":"9453f0c5-6252-492a-86fc-7e2ebb4f241e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":86605},{"type":"v1","addr":"172.21.15.69:6809","nonce":86605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":86605},{"type":"v1","addr":"172.21.15.69:6811","nonce":86605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":86605},{"type":"v1","addr":"172.21.15.69:6815","nonce":86605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":86605},{"type":"v1","addr":"172.21.15.69:6813","nonce":86605}]},"public_addr":"172.21.15.69:6809/86605","cluster_addr":"172.21.15.69:6811/86605","heartbeat_back_addr":"172.21.15.69:6815/86605","heartbeat_front_addr":"172.21.15.69:6813/86605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.888190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.815570+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T13:16:32.891847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T16:19:44.120 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:44.120+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:44.261 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:44.260+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:44.589 INFO:tasks.ceph:Scrubbing osd.0 2023-09-28T16:19:44.589 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-28T16:19:45.119 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:45.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:45.305 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:45.305+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:46.077 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:46.076+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:46.338 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:46.337+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:47.067 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:47.066+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:47.339 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:47.338+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:48.057 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:48.056+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:48.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:48.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:49.008 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:49.007+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:49.349 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:49.349+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:50.058 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:50.058+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:50.340 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:50.340+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:51.106 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:51.107+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:51.341 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:51.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:52.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:52.132+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:52.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:52.381+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:53.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:53.146+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:53.392 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:53.393+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:54.187 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:54.187+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:54.395 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:54.395+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:55.235 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:55.235+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:55.406 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:55.406+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:56.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:56.245+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:56.397 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:56.398+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:57.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:57.290+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:57.421 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:57.422+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:58.305 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:58.306+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:58.403 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:58.403+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:59.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:19:59.266+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:19:59.428 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:19:59.429+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:00.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:00.252+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:00.381 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:00.381+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:01.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:01.280+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:01.353 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:01.353+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:02.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:02.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:02.359 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:02.358+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:03.262 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:03.262+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:03.345 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:03.345+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:04.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:04.246+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:04.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:04.342+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:05.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:05.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:05.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:05.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:06.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:06.241+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:06.361 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:06.360+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:07.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:07.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:07.376 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:07.375+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:08.181 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:08.180+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:08.360 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:08.359+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:09.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:09.229+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:09.316 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:09.316+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:10.202 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:10.201+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:10.363 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:10.362+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:11.220 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:11.219+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:11.362 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:11.361+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:12.205 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:12.204+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:12.377 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:12.377+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:13.249 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:13.249+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:13.385 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:13.385+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:14.215 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:14.215+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:14.411 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:14.410+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:15.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:15.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:15.427 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:15.427+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:16.151 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:16.150+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:16.463 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:16.462+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:17.178 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:17.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:17.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:17.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:18.137 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:18.136+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:18.538 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:18.534+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:19.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:19.132+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:19.568 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:19.567+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:20.155 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:20.155+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:20.530 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:20.529+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:21.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:21.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:21.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:21.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:22.173 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:22.172+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:22.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:22.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:23.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:23.165+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:23.590 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:23.589+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:24.149 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:24.148+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:24.623 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:24.622+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:25.124 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:25.123+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:25.634 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:25.634+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:26.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:26.126+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:26.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:26.622+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:27.084 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:27.084+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:27.600 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:27.599+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:28.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:28.038+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:28.556 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:28.555+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:29.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:29.061+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:29.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:29.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:30.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:30.101+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:30.579 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:30.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:31.142 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:31.141+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:31.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:31.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:32.161 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:32.161+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:32.583 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:32.582+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:33.129 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:33.128+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:33.591 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:33.590+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:34.180 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:34.179+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:34.631 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:34.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:35.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:35.135+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:35.645 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:35.645+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:36.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:36.167+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:36.641 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:36.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:37.135 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:37.136+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:37.682 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:37.682+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:38.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:38.098+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:38.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:38.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:39.128 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:39.128+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:39.739 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:39.739+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:40.138 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:40.138+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:40.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:40.756+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:41.182 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:41.183+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:41.713 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:41.714+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:42.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:42.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:42.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:42.721+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:43.212 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:43.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:43.719 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:43.719+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:44.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:44.190+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:44.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:44.727+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:45.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:45.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:45.709 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:45.710+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:46.180 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:46.179+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:46.704 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:46.703+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:47.210 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:47.209+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:47.686 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:47.686+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:48.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:48.174+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:48.666 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:48.665+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:49.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:49.220+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:49.707 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:49.706+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:50.203 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:50.203+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:50.735 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:50.735+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:51.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:51.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:51.744 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:51.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:52.170 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:52.170+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:52.754 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:52.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:53.130 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:53.130+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:53.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:53.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:54.126 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:54.125+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:54.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:54.754+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:55.162 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:55.161+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:55.762 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:55.762+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:56.211 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:56.211+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:56.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:56.742+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:57.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:57.259+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:57.738 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:57.737+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:58.287 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:58.287+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:58.696 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:58.696+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:59.247 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:20:59.247+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:20:59.670 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:20:59.669+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:00.217 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:00.216+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:00.714 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:00.713+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:01.219 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:01.218+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:01.745 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:01.744+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:02.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:02.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:02.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:02.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:03.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:03.263+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:03.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:03.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:04.296 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:04.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:04.826 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:04.825+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:05.318 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:05.317+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:05.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:05.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:06.293 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:06.292+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:06.801 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:06.800+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:07.343 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:07.342+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:07.842 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:07.841+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:08.368 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:08.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:08.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:08.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:09.415 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:09.414+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:09.917 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:09.916+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:10.400 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:10.399+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:10.939 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:10.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:11.383 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:11.383+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:11.969 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:11.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:12.373 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:12.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:13.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:13.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:13.339 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:13.339+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:14.049 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:14.048+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:14.345 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:14.345+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:15.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:15.009+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:15.305 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:15.304+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:16.056 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:16.056+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:16.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:16.260+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:17.064 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:17.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:17.230 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:17.229+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:18.109 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:18.108+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:18.251 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:18.251+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:19.084 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:19.084+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:19.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:19.296+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:20.135 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:20.134+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:20.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:20.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:21.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:21.104+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:21.306 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:21.306+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:22.147 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:22.146+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:22.274 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:22.273+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:23.189 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:23.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:23.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:23.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:24.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:24.208+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:24.252 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:24.252+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:25.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:25.215+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:25.244 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:25.244+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:26.205 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:26.205+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:26.214 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:26.215+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:27.211 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:27.211+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:27.253 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:27.253+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:28.248 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:28.248+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:28.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:28.284+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:29.215 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:29.216+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:29.257 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:29.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:30.232 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:30.231+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:30.298 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:30.298+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:31.258 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:31.259+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:31.348 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:31.348+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:32.233 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:32.232+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:32.365 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:32.364+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:33.243 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:33.242+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:33.353 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:33.352+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:34.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:34.233+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:34.378 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:34.377+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:35.257 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:35.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:35.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:35.406+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:36.245 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:36.244+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:36.431 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:36.430+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:37.255 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:37.255+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:37.390 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:37.389+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:38.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:38.277+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:38.383 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:38.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:39.290 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:39.289+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:39.357 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:39.357+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:40.265 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:40.264+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:40.315 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:40.315+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:41.304 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:41.303+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:41.323 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:41.323+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:42.295 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:42.295+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:42.329 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:42.329+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:43.264 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:43.264+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:43.284 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:43.284+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:44.244 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:44.243+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:44.269 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:44.268+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:44.620 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-28T16:21:44.620 INFO:tasks.ceph:Scrubbing osd.1 2023-09-28T16:21:44.621 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-28T16:21:45.221 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:45.221+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:45.250 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:45.250+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:46.247 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:46.246+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:46.266 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:46.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:47.218 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:47.217+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:47.261 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:47.261+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:48.188 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:48.187+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:48.259 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:48.258+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:49.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:49.160+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:49.290 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:49.289+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:50.194 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:50.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:50.317 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:50.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:51.209 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:51.209+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:51.329 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:51.329+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:52.193 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:52.193+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:52.380 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:52.379+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:53.214 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:53.213+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:53.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:53.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:54.168 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:54.167+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:54.438 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:54.438+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:55.212 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:55.212+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:55.487 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:55.487+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:56.212 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:56.211+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:56.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:56.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:57.192 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:57.190+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:57.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:57.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:58.161 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:58.160+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:58.450 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:58.449+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:59.155 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:21:59.155+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:21:59.404 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:21:59.403+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:00.114 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:00.113+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:00.406 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:00.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:01.124 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:01.123+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:01.398 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:01.397+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:02.118 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:02.117+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:02.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:02.366+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:03.150 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:03.149+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:03.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:03.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:04.182 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:04.182+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:04.407 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:04.407+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:05.228 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:05.227+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:05.367 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:05.367+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:06.204 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:06.203+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:06.355 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:06.355+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:07.237 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:07.237+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:07.375 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:07.374+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:08.234 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:08.234+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:08.419 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:08.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:09.258 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:09.259+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:09.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:09.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:10.238 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:10.239+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:10.429 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:10.429+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:11.278 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:11.278+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:11.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:11.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:12.256 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:12.256+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:12.489 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:12.489+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:13.273 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:13.273+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:13.445 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:13.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:14.294 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:14.294+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:14.495 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:14.496+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:15.342 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:15.343+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:15.539 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:15.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:16.386 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:16.387+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:16.500 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:16.501+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:17.429 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:17.429+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:17.470 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:17.471+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:18.478 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:18.478+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:18.480 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:18.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:19.446 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:19.445+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:19.526 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:19.525+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:20.457 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:20.456+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:20.491 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:20.491+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:21.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:21.475+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:21.494 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:21.494+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:22.446 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:22.445+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:22.466 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:22.466+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:23.400 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:23.399+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:23.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:23.421+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:24.417 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:24.416+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:24.423 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:24.423+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:25.398 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:25.398+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:25.470 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:25.470+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:26.444 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:26.443+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:26.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:26.501+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:27.441 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:27.441+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:27.484 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:27.483+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:28.422 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:28.422+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:28.489 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:28.488+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:29.397 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:29.396+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:29.524 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:29.523+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:30.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:30.371+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:30.548 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:30.547+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:31.354 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:31.354+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:31.550 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:31.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:32.382 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:32.382+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:32.514 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:32.513+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:33.386 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:33.386+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:33.532 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:33.531+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:34.436 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:34.435+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:34.570 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:34.569+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:35.421 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:35.420+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:35.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:35.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:36.456 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:36.455+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:36.557 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:36.557+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:37.486 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:37.486+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:37.603 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:37.603+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:38.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:38.496+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:38.580 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:38.579+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:39.475 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:39.474+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:39.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:39.573+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:40.488 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:40.487+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:40.565 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:40.565+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:41.531 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:41.531+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:41.614 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:41.614+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:42.527 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:42.527+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:42.596 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:42.595+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:43.501 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:43.500+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:43.592 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:43.592+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:44.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:44.496+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:44.605 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:44.605+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:45.534 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:45.533+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:45.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:45.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:46.532 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:46.532+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:46.629 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:46.628+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:47.494 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:47.494+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:47.636 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:47.635+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:48.524 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:48.524+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:48.604 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:48.604+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:49.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:49.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:49.573 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:49.572+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:50.535 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:50.534+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:50.607 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:50.607+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:51.499 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:51.498+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:51.640 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:51.640+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:52.522 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:52.522+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:52.678 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:52.677+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:53.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:53.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:53.721 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:53.720+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:54.517 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:54.516+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:54.743 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:54.743+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:55.479 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:55.479+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:55.789 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:55.789+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:56.513 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:56.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:56.802 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:56.802+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:57.496 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:57.497+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:57.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:57.761+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:58.463 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:58.463+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:58.761 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:58.762+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:59.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:22:59.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:22:59.780 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:22:59.781+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:00.511 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:00.511+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:00.779 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:00.779+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:01.482 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:01.483+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:01.755 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:01.755+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:02.514 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:02.514+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:02.756 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:02.757+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:03.560 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:03.561+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:03.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:03.804+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:04.552 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:04.552+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:04.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:04.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:05.592 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:05.592+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:05.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:05.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:06.642 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:06.641+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:06.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:06.830+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:07.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:07.680+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:07.808 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:07.808+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:08.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:08.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:08.855 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:08.854+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:09.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:09.720+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:09.866 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:09.866+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:10.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:10.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:10.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:10.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:11.720 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:11.719+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:11.832 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:11.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:12.715 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:12.714+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:12.792 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:12.792+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:13.730 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:13.730+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:13.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:13.830+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:14.751 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:14.750+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:14.798 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:14.797+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:15.783 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:15.783+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:15.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:15.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:16.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:16.818+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:16.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:16.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:17.848 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:17.848+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:17.896 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:17.895+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:18.809 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:18.808+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:18.886 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:18.886+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:19.785 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:19.785+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:19.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:19.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:20.820 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:20.820+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:20.904 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:20.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:21.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:21.833+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:21.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:21.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:22.819 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:22.818+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:22.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:22.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:23.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:23.822+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:23.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:23.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:24.798 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:24.798+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:24.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:24.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:25.835 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:25.834+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:25.893 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:25.892+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:26.862 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:26.861+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:26.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:26.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:27.906 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:27.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:27.960 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:27.960+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:28.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:28.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:28.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:28.972+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:29.892 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:29.892+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:30.025 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:29.978+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:30.896 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:30.895+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:30.956 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:30.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:31.915 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:31.915+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:31.932 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:31.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:32.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:32.928+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:32.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:32.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:33.945 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:33.944+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:34.010 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:34.010+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:34.900 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:34.900+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:34.972 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:34.971+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:35.928 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:35.928+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:35.935 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:35.935+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:36.929 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:36.928+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:36.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:36.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:37.958 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:37.957+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:37.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:37.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:38.932 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:38.932+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:38.950 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:38.950+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:39.944 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:39.943+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:39.976 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:39.976+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:40.992 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:40.991+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:41.023 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:41.022+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:41.963 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:41.964+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:42.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:42.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:42.952 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:42.953+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:43.037 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:43.037+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:43.954 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:43.955+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:44.044 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:44.044+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:44.650 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-28T16:23:44.651 INFO:tasks.ceph:Scrubbing osd.2 2023-09-28T16:23:44.651 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-28T16:23:44.791 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-09-28T16:23:44.791 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T16:23:44.791 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-09-28T16:23:44.803 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-28T16:23:44.938 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:44.938+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:45.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:45.039+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:45.142 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 2 to deep-scrub 2023-09-28T16:23:45.153 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:23:45.482 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:23:45.484 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:23:45.496 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5771,"stamp":"2023-09-28T16:23:44.176483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26821,"ondisk_log_size":26821,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":681348,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":176640,"kb_avail":282434172,"statfs":{"total":289910292480,"available":289212592128,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180879360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001799"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"158'1680","reported_seq":2614,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193412+0000","last_change":"2023-09-28T13:21:19.921744+0000","last_active":"2023-09-28T14:19:27.193412+0000","last_peered":"2023-09-28T14:19:27.193412+0000","last_clean":"2023-09-28T14:19:27.193412+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T14:19:27.193412+0000","last_undegraded":"2023-09-28T14:19:27.193412+0000","last_fullsized":"2023-09-28T14:19:27.193412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1680,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:25:43.877047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"158'1063","reported_seq":1972,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193704+0000","last_change":"2023-09-28T13:21:19.921823+0000","last_active":"2023-09-28T14:19:27.193704+0000","last_peered":"2023-09-28T14:19:27.193704+0000","last_clean":"2023-09-28T14:19:27.193704+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T14:19:27.193704+0000","last_undegraded":"2023-09-28T14:19:27.193704+0000","last_fullsized":"2023-09-28T14:19:27.193704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1063,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:32:03.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9253,"ondisk_log_size":9253,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740621,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254660,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":71296,"kb_avail":94117180,"statfs":{"total":96636764160,"available":96375992320,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73007104},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.222,"15min":0.22600000000000001},"min":{"1min":0.151,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.39200000000000002,"5min":0.41699999999999998,"15min":0.46100000000000002},"last":0.151},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.25800000000000001,"15min":0.26400000000000001},"min":{"1min":0.21299999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.55100000000000005},"last":0.19700000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23999999999999999},"min":{"1min":0.17299999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.497},"last":0.16800000000000001},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.27800000000000002,"15min":0.28199999999999997},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.52000000000000002},"last":0.23300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.20399999999999999,"5min":0.20999999999999999,"15min":0.218},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.182},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.23400000000000001,"15min":0.23499999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.214}]},{"osd":2,"last update":"Thu Sep 28 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.24099999999999999,"15min":0.248},"min":{"1min":0.17899999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.26200000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.41699999999999998,"5min":0.42699999999999999,"15min":0.55000000000000004},"last":0.252}]}]},{"osd":1,"up_from":8,"seq":34359740621,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245360,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94126480,"statfs":{"total":96636764160,"available":96385515520,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.20000000000000001,"5min":0.20499999999999999,"15min":0.21099999999999999},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":0.26100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26100000000000001,"15min":0.26700000000000002},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.17199999999999999},"max":{"1min":0.32000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Sep 28 16:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.222,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.28199999999999997,"5min":0.443,"15min":0.443},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.254,"15min":0.26100000000000001},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.184},"max":{"1min":0.32100000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.23599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:23:45.500 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.500 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.500 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.500 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.501 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.501 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.501 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.501 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.501 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.501 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.502 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.502 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.502 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:23:45.502 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:23:45.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:45.930+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:46.028 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:46.029+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:46.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:46.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:47.070 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:47.070+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:47.981 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:47.981+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:48.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:48.109+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:49.022 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:49.022+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:49.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:49.073+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:49.990 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:49.990+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:50.038 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:50.038+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:51.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:51.025+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:51.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:51.071+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:51.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:51.996+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:52.107 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:52.106+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:52.994 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:52.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:53.115 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:53.115+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:53.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:53.988+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:54.147 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:54.146+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:55.000 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:54.999+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:55.098 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:55.097+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:56.033 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:56.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:56.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:56.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:57.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:57.036+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:57.189 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:57.188+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:58.039 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:58.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:58.200 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:58.199+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:59.058 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:23:59.058+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:23:59.224 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:23:59.223+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:00.037 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:00.037+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:00.241 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:00.241+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:01.059 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:01.059+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:01.265 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:01.265+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:02.105 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:02.105+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:02.255 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:02.255+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:03.096 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:03.095+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:03.280 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:03.279+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:04.071 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:04.071+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:04.258 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:04.257+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:05.117 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:05.116+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:05.307 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:05.307+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:05.503 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:24:05.866 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:24:05.868 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:24:05.881 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5781,"stamp":"2023-09-28T16:24:04.179640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26916,"ondisk_log_size":26916,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665220,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":160512,"kb_avail":282450300,"statfs":{"total":289910292480,"available":289229107200,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164364288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001856"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9348,"ondisk_log_size":9348,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740625,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238404,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94133436,"statfs":{"total":96636764160,"available":96392638464,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.222,"15min":0.22600000000000001},"min":{"1min":0.151,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.39200000000000002,"5min":0.41699999999999998,"15min":0.46100000000000002},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.25800000000000001,"15min":0.26400000000000001},"min":{"1min":0.21299999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.55100000000000005},"last":0.23100000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23999999999999999},"min":{"1min":0.17299999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.497},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.27800000000000002,"15min":0.28199999999999997},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.52000000000000002},"last":0.25800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740622,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.20399999999999999,"5min":0.20999999999999999,"15min":0.218},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.23400000000000001,"15min":0.23499999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.20100000000000001}]},{"osd":2,"last update":"Thu Sep 28 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.24099999999999999,"15min":0.248},"min":{"1min":0.17899999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.221},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.26200000000000001},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.41699999999999998,"5min":0.42699999999999999,"15min":0.55000000000000004},"last":0.23799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740625,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245488,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60288,"kb_avail":94126352,"statfs":{"total":96636764160,"available":96385384448,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61734912},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.20000000000000001,"5min":0.20499999999999999,"15min":0.21099999999999999},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":0.26100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26100000000000001,"15min":0.26700000000000002},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.17199999999999999},"max":{"1min":0.32000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Sep 28 16:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.222,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.28199999999999997,"5min":0.443,"15min":0.443},"last":0.223},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.254,"15min":0.26100000000000001},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.184},"max":{"1min":0.32100000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.25900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:24:05.882 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.883 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.883 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.883 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.883 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.883 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.884 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.884 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.884 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.884 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.884 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:05.884 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:24:06.083 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:06.082+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:06.328 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:06.327+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:07.050 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:07.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:07.370 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:07.369+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:08.020 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:08.019+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:08.385 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:08.384+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:09.011 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:09.011+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:09.372 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:09.372+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:10.026 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:10.026+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:10.346 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:10.346+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:11.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:11.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:11.333 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:11.333+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:12.040 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:12.039+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:12.316 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:12.316+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:13.028 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:13.028+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:13.311 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:13.311+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:13.995 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:13.994+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:14.283 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:14.282+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:14.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:14.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:15.268 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:15.267+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:15.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:15.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:16.233 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:16.232+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:17.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:17.013+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:17.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:17.205+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:18.043 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:18.043+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:18.175 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:18.174+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:19.041 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:19.040+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:19.143 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:19.142+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:20.052 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:20.052+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:20.097 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:20.097+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:21.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:21.046+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:21.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:21.133+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:21.999 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:21.998+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:22.167 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:22.166+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:23.048 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:23.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:23.134 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:23.133+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:24.005 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:24.005+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:24.103 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:24.103+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:25.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:25.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:25.139 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:25.139+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:25.885 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:24:26.044 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:26.044+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:26.108 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:26.108+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:26.199 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:24:26.202 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:24:26.212 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5792,"stamp":"2023-09-28T16:24:26.183255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26916,"ondisk_log_size":26916,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665220,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":160512,"kb_avail":282450300,"statfs":{"total":289910292480,"available":289229107200,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164364288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001985"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9348,"ondisk_log_size":9348,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740629,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238404,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94133436,"statfs":{"total":96636764160,"available":96392638464,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.222,"15min":0.22600000000000001},"min":{"1min":0.151,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.39200000000000002,"5min":0.41699999999999998,"15min":0.46100000000000002},"last":0.188},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.25800000000000001,"15min":0.26400000000000001},"min":{"1min":0.21299999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.55100000000000005},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.25800000000000001,"5min":0.23699999999999999,"15min":0.23999999999999999},"min":{"1min":0.17299999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.497},"last":0.217},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.27800000000000002,"15min":0.28199999999999997},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.52000000000000002},"last":0.307}]}]},{"osd":0,"up_from":8,"seq":34359740626,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.33700000000000002,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.371},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23599999999999999,"15min":0.23400000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.38500000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Sep 28 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.247},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17399999999999999},"max":{"1min":0.372,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26100000000000001},"min":{"1min":0.20200000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.34699999999999998,"5min":0.42699999999999999,"15min":0.49299999999999999},"last":0.45200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740629,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245488,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60288,"kb_avail":94126352,"statfs":{"total":96636764160,"available":96385384448,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61734912},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.20100000000000001,"15min":0.20999999999999999},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.255,"5min":0.25800000000000001,"15min":0.26600000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.221,"15min":0.22900000000000001},"min":{"1min":0.17599999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.443},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.254,"15min":0.26000000000000001},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.434,"5min":0.434,"15min":0.48199999999999998},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:24:26.214 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.214 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.214 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.215 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.215 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.215 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.215 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.215 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.216 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.216 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.216 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:26.216 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:24:27.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:27.004+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:27.148 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:27.148+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:28.047 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:28.047+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:28.102 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:28.102+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:29.088 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:29.087+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:29.109 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:29.109+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:30.071 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:30.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:30.103 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:30.103+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:31.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:31.093+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:31.118 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:31.118+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:32.092 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:32.092+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:32.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:32.151+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:33.111 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:33.112+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:33.177 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:33.177+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:34.110 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:34.111+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:34.152 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:34.153+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:35.146 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:35.146+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:35.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:35.169+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:36.097 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:36.097+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:36.206 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:36.207+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:37.072 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:37.072+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:37.164 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:37.164+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:38.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:38.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:38.127 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:38.127+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:39.018 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:39.018+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:39.165 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:39.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:40.013 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:40.012+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:40.169 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:40.169+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:41.031 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:41.031+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:41.213 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:41.212+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:41.986 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:41.985+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:42.186 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:42.185+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:43.003 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:43.002+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:43.145 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:43.145+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:43.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:43.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:44.150 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:44.149+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:44.989 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:44.989+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:45.166 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:45.165+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:45.980 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:45.979+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:46.122 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:46.122+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:46.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:24:46.565 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:24:46.566 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:24:46.578 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5802,"stamp":"2023-09-28T16:24:46.186160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26916,"ondisk_log_size":26916,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665220,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":160512,"kb_avail":282450300,"statfs":{"total":289910292480,"available":289229107200,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164364288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001773"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9348,"ondisk_log_size":9348,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740633,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238404,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94133436,"statfs":{"total":96636764160,"available":96392638464,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.151,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.40200000000000002,"5min":0.41699999999999998,"15min":0.443},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26500000000000001},"min":{"1min":0.19700000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.55100000000000005},"last":0.24199999999999999}]},{"osd":1,"last update":"Thu Sep 28 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.24199999999999999,"15min":0.23999999999999999},"min":{"1min":0.16800000000000001,"5min":0.16600000000000001,"15min":0.16},"max":{"1min":0.42599999999999999,"5min":0.47399999999999998,"15min":0.497},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.191,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.52000000000000002},"last":0.27300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740630,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.33700000000000002,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23599999999999999,"15min":0.23400000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.38500000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.21199999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.247},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17399999999999999},"max":{"1min":0.372,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26100000000000001},"min":{"1min":0.20200000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.34699999999999998,"5min":0.42699999999999999,"15min":0.49299999999999999},"last":0.24099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740633,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245488,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60288,"kb_avail":94126352,"statfs":{"total":96636764160,"available":96385384448,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61734912},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.20100000000000001,"15min":0.20999999999999999},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.255,"5min":0.25800000000000001,"15min":0.26600000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.221,"15min":0.22900000000000001},"min":{"1min":0.17599999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.443},"last":0.376},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.254,"15min":0.26000000000000001},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.434,"5min":0.434,"15min":0.48199999999999998},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:24:46.580 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.580 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.580 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.580 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.581 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.581 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.581 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.581 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.581 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.581 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.582 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:24:46.582 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:24:47.009 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:47.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:47.133 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:47.133+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:48.051 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:48.050+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:48.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:48.100+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:49.063 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:49.063+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:49.065 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:49.065+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:50.038 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:50.038+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:50.093 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:50.093+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:51.029 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:51.029+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:51.063 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:51.063+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:51.984 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:51.983+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:52.111 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:52.110+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:52.978 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:52.977+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:53.132 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:53.131+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:53.957 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:53.956+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:54.085 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:54.085+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:54.946 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:54.946+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:55.053 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:55.052+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:55.933 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:55.932+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:56.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:56.009+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:56.892 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:56.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:56.968 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:56.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:57.861 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:57.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:57.969 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:57.968+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:58.883 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:58.883+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:59.005 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:59.004+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:59.870 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:24:59.870+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:24:59.971 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:24:59.970+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:00.887 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:00.887+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:00.997 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:00.997+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:01.911 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:01.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:02.039 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:02.038+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:02.919 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:02.918+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:03.073 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:03.072+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:03.936 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:03.935+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:04.101 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:04.101+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:04.953 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:04.951+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:05.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:05.054+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:05.910 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:05.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:06.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:06.053+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:06.583 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:25:06.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-09-28T16:25:06.899+0000 7fc717fff700 0 --2- 172.21.15.69:0/2953636810 >> v2:172.21.15.69:3300/0 conn(0x7fc7181269a0 0x7fc718126450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-28T16:25:06.934 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:06.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:07.010 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:07.010+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:25:07.100 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:25:07.111 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5812,"stamp":"2023-09-28T16:25:06.189099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26916,"ondisk_log_size":26916,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665220,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":160512,"kb_avail":282450300,"statfs":{"total":289910292480,"available":289229107200,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164364288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001670"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9348,"ondisk_log_size":9348,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740637,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238404,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94133436,"statfs":{"total":96636764160,"available":96392638464,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.151,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.40200000000000002,"5min":0.41699999999999998,"15min":0.443},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26500000000000001},"min":{"1min":0.19700000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.55100000000000005},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Sep 28 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.24199999999999999,"15min":0.23999999999999999},"min":{"1min":0.16800000000000001,"5min":0.16600000000000001,"15min":0.16},"max":{"1min":0.42599999999999999,"5min":0.47399999999999998,"15min":0.497},"last":0.313},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.191,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.52000000000000002},"last":0.38900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740634,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.33700000000000002,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.156},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23599999999999999,"15min":0.23400000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.38500000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.20000000000000001}]},{"osd":2,"last update":"Thu Sep 28 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.247},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17399999999999999},"max":{"1min":0.372,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.216},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26100000000000001},"min":{"1min":0.20200000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.34699999999999998,"5min":0.42699999999999999,"15min":0.49299999999999999},"last":0.24199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740637,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245488,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60288,"kb_avail":94126352,"statfs":{"total":96636764160,"available":96385384448,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61734912},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.20100000000000001,"15min":0.20999999999999999},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.156},{"interface":"front","average":{"1min":0.255,"5min":0.25800000000000001,"15min":0.26600000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.217}]},{"osd":2,"last update":"Thu Sep 28 16:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.221,"15min":0.22900000000000001},"min":{"1min":0.17599999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.443},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.254,"15min":0.26000000000000001},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.434,"5min":0.434,"15min":0.48199999999999998},"last":0.24099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:25:07.113 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.113 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.113 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.113 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.113 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.114 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.114 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.114 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.114 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.114 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.114 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:07.115 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:25:07.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:07.912+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:07.966 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:07.965+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:08.899 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:08.899+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:08.936 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:08.935+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:09.858 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:09.857+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:09.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:09.904+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:10.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:10.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:10.879 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:10.878+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:11.807 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:11.807+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:11.883 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:11.883+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:12.804 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:12.804+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:12.837 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:12.836+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:13.769 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:13.769+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:13.864 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:13.865+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:14.749 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:14.749+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:14.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:14.835+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:15.708 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:15.708+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:15.822 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:15.822+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:16.690 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:16.691+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:16.834 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:16.835+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:17.700 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:17.700+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:17.792 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:17.792+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:18.726 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:18.726+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:18.816 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:18.816+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:19.701 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:19.701+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:19.826 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:19.827+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:20.675 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:20.675+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:20.838 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:20.839+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:21.655 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:21.655+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:21.886 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:21.887+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:22.637 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:22.637+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:22.905 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:22.905+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:23.632 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:23.631+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:23.865 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:23.865+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:24.622 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:24.621+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:24.907 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:24.906+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:25.608 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:25.608+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:25.882 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:25.882+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:26.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:26.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:26.836 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:26.835+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:27.117 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:25:27.435 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:25:27.438 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:25:27.450 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5822,"stamp":"2023-09-28T16:25:26.192166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26916,"ondisk_log_size":26916,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665220,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":160512,"kb_avail":282450300,"statfs":{"total":289910292480,"available":289229107200,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164364288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001954"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9348,"ondisk_log_size":9348,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740641,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238404,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94133436,"statfs":{"total":96636764160,"available":96392638464,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.151,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.40200000000000002,"5min":0.41699999999999998,"15min":0.443},"last":0.25},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26500000000000001},"min":{"1min":0.19700000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.55100000000000005},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Sep 28 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.24199999999999999,"15min":0.23999999999999999},"min":{"1min":0.16800000000000001,"5min":0.16600000000000001,"15min":0.16},"max":{"1min":0.42599999999999999,"5min":0.47399999999999998,"15min":0.497},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.191,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.52000000000000002},"last":0.29199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740638,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.156,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.371,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.311},{"interface":"front","average":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23499999999999999},"min":{"1min":0.16400000000000001,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.372}]},{"osd":2,"last update":"Thu Sep 28 16:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24299999999999999,"15min":0.247},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.438,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"min":{"1min":0.19400000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.49299999999999999},"last":0.34899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740641,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245488,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60288,"kb_avail":94126352,"statfs":{"total":96636764160,"available":96385384448,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61734912},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20999999999999999},"min":{"1min":0.156,"5min":0.14399999999999999,"15min":0.13900000000000001},"max":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26700000000000002},"min":{"1min":0.217,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.43099999999999999,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.223,"15min":0.23000000000000001},"min":{"1min":0.19600000000000001,"5min":0.152,"15min":0.152},"max":{"1min":0.376,"5min":0.39600000000000002,"15min":0.443},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.26200000000000001},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.41599999999999998,"5min":0.434,"15min":0.48199999999999998},"last":0.23300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:25:27.451 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.451 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.452 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.452 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.452 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.452 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.452 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.452 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.453 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.453 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.453 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:27.453 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:25:27.534 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:27.533+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:27.844 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:27.844+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:28.496 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:28.496+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:28.801 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:28.801+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:29.477 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:29.476+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:29.786 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:29.786+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:30.504 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:30.503+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:30.772 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:30.771+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:31.455 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:31.455+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:31.795 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:31.794+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:32.505 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:32.504+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:32.760 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:32.759+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:33.549 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:33.549+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:33.719 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:33.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:34.508 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:34.508+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:34.670 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:34.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:35.553 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:35.553+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:35.688 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:35.687+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:36.567 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:36.566+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:36.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:36.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:37.564 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:37.564+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:37.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:37.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:38.576 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:38.576+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:38.635 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:38.634+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:39.540 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:39.539+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:39.679 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:39.679+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:40.512 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:40.512+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:40.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:40.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:41.528 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:41.528+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:41.681 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:41.680+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:42.558 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:42.558+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:42.678 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:42.656+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:43.542 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:43.542+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:43.656 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:43.656+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:44.562 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:44.561+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:44.658 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:44.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:45.574 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:45.574+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:45.692 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:45.691+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:46.613 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:46.612+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:46.697 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:46.696+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:47.454 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:25:47.660 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:47.659+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:47.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:47.704+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:47.774 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:25:47.776 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:25:47.787 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5832,"stamp":"2023-09-28T16:25:46.195034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26916,"ondisk_log_size":26916,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665220,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":160512,"kb_avail":282450300,"statfs":{"total":289910292480,"available":289229107200,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164364288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001688"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9348,"ondisk_log_size":9348,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740645,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238404,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94133436,"statfs":{"total":96636764160,"available":96392638464,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.154,"5min":0.14299999999999999,"15min":0.14199999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.26800000000000002},"min":{"1min":0.23400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.55100000000000005},"last":0.23400000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.246,"15min":0.24099999999999999},"min":{"1min":0.17299999999999999,"5min":0.16600000000000001,"15min":0.16},"max":{"1min":0.436,"5min":0.47399999999999998,"15min":0.497},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28499999999999998},"min":{"1min":0.23000000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.19700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740642,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.156,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.371,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23499999999999999},"min":{"1min":0.16400000000000001,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24299999999999999,"15min":0.247},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.438,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"min":{"1min":0.19400000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.49299999999999999},"last":0.33000000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740645,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245488,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60288,"kb_avail":94126352,"statfs":{"total":96636764160,"available":96385384448,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61734912},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20999999999999999},"min":{"1min":0.156,"5min":0.14399999999999999,"15min":0.13900000000000001},"max":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26700000000000002},"min":{"1min":0.217,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.43099999999999999,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Sep 28 16:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.223,"15min":0.23000000000000001},"min":{"1min":0.19600000000000001,"5min":0.152,"15min":0.152},"max":{"1min":0.376,"5min":0.39600000000000002,"15min":0.443},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.26200000000000001},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.41599999999999998,"5min":0.434,"15min":0.48199999999999998},"last":0.245}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:25:47.788 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.788 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.789 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.789 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.789 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.789 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.789 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.790 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.790 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.790 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.790 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:25:47.790 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:25:48.680 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:48.680+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:48.735 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:48.734+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:49.712 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:49.712+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:49.780 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:49.780+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:50.745 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:50.745+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:50.766 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:50.766+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:51.764 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:51.764+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:51.791 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:51.790+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:52.721 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:52.721+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:52.823 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:52.823+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:53.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:53.698+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:53.829 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:53.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:54.734 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:54.734+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:54.874 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:54.874+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:55.706 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:55.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:55.848 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:55.848+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:56.664 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:56.664+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:56.820 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:56.820+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:57.690 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:57.690+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:57.830 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:57.830+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:58.655 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:58.655+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:58.828 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:58.827+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:59.624 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:25:59.624+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:25:59.871 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:25:59.872+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:00.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:00.657+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:00.827 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:00.828+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:01.675 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:01.676+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:01.860 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:01.861+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:02.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:02.648+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:02.873 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:02.874+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:03.604 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:03.604+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:03.869 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:03.869+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:04.572 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:04.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:04.905 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:04.906+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:05.553 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:05.553+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:05.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:05.910+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:06.555 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:06.555+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:06.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:06.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:07.571 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:07.572+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:07.792 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:26:07.831 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:07.832+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:08.107 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:26:08.110 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:26:08.120 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5842,"stamp":"2023-09-28T16:26:06.198188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26916,"ondisk_log_size":26916,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665220,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":160512,"kb_avail":282450300,"statfs":{"total":289910292480,"available":289229107200,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164364288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001881"},"pg_stats":[{"pgid":"2.7","version":"158'1015","reported_seq":1967,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193632+0000","last_change":"2023-09-28T13:21:19.933665+0000","last_active":"2023-09-28T14:19:27.193632+0000","last_peered":"2023-09-28T14:19:27.193632+0000","last_clean":"2023-09-28T14:19:27.193632+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T14:19:27.193632+0000","last_undegraded":"2023-09-28T14:19:27.193632+0000","last_fullsized":"2023-09-28T14:19:27.193632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1015,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:26:45.952621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1740,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193583+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:27.193583+0000","last_peered":"2023-09-28T14:19:27.193583+0000","last_clean":"2023-09-28T14:19:27.193583+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:27.193583+0000","last_undegraded":"2023-09-28T14:19:27.193583+0000","last_fullsized":"2023-09-28T14:19:27.193583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:40:54.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1976,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:44:36.943733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"158'4081","reported_seq":9355,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195213+0000","last_change":"2023-09-28T13:21:19.924105+0000","last_active":"2023-09-28T14:19:27.195213+0000","last_peered":"2023-09-28T14:19:27.195213+0000","last_clean":"2023-09-28T14:19:27.195213+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T14:19:27.195213+0000","last_undegraded":"2023-09-28T14:19:27.195213+0000","last_fullsized":"2023-09-28T14:19:27.195213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4081,"ondisk_log_size":4081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:46:30.755747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10639,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193386+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:27.193386+0000","last_peered":"2023-09-28T14:19:27.193386+0000","last_clean":"2023-09-28T14:19:27.193386+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:27.193386+0000","last_undegraded":"2023-09-28T14:19:27.193386+0000","last_fullsized":"2023-09-28T14:19:27.193386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:54:41.154858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":282,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193248+0000","last_change":"2023-09-28T13:16:39.731345+0000","last_active":"2023-09-28T14:19:27.193248+0000","last_peered":"2023-09-28T14:19:27.193248+0000","last_clean":"2023-09-28T14:19:27.193248+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T14:19:27.193248+0000","last_undegraded":"2023-09-28T14:19:27.193248+0000","last_fullsized":"2023-09-28T14:19:27.193248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:38.721793+0000","last_clean_scrub_stamp":"2023-09-28T13:16:38.721793+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:38:06.216565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"158'1419","reported_seq":2404,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193473+0000","last_change":"2023-09-28T13:21:19.933166+0000","last_active":"2023-09-28T14:19:27.193473+0000","last_peered":"2023-09-28T14:19:27.193473+0000","last_clean":"2023-09-28T14:19:27.193473+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T14:19:27.193473+0000","last_undegraded":"2023-09-28T14:19:27.193473+0000","last_fullsized":"2023-09-28T14:19:27.193473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1419,"ondisk_log_size":1419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:45:32.882387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11120,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193336+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:27.193336+0000","last_peered":"2023-09-28T14:19:27.193336+0000","last_clean":"2023-09-28T14:19:27.193336+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:27.193336+0000","last_undegraded":"2023-09-28T14:19:27.193336+0000","last_fullsized":"2023-09-28T14:19:27.193336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:11:49.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"158'4525","reported_seq":12252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195267+0000","last_change":"2023-09-28T13:21:19.926645+0000","last_active":"2023-09-28T14:19:27.195267+0000","last_peered":"2023-09-28T14:19:27.195267+0000","last_clean":"2023-09-28T14:19:27.195267+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T14:19:27.195267+0000","last_undegraded":"2023-09-28T14:19:27.195267+0000","last_fullsized":"2023-09-28T14:19:27.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4525,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:49:02.025327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"158'1116","reported_seq":2167,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.195218+0000","last_change":"2023-09-28T13:21:19.923540+0000","last_active":"2023-09-28T14:19:27.195218+0000","last_peered":"2023-09-28T14:19:27.195218+0000","last_clean":"2023-09-28T14:19:27.195218+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T14:19:27.195218+0000","last_undegraded":"2023-09-28T14:19:27.195218+0000","last_fullsized":"2023-09-28T14:19:27.195218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1116,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:05:31.974589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"158'970","reported_seq":1942,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-09-28T14:19:27.193528+0000","last_change":"2023-09-28T13:21:19.933619+0000","last_active":"2023-09-28T14:19:27.193528+0000","last_peered":"2023-09-28T14:19:27.193528+0000","last_clean":"2023-09-28T14:19:27.193528+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T14:19:27.193528+0000","last_undegraded":"2023-09-28T14:19:27.193528+0000","last_fullsized":"2023-09-28T14:19:27.193528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":970,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:41:55.170996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17471,"ondisk_log_size":17471,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":592,"num_omap_keys":65,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9348,"ondisk_log_size":9348,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740649,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238404,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94133436,"statfs":{"total":96636764160,"available":96392638464,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.154,"5min":0.14299999999999999,"15min":0.14199999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.26800000000000002},"min":{"1min":0.23400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.55100000000000005},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Sep 28 16:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.246,"15min":0.24099999999999999},"min":{"1min":0.17299999999999999,"5min":0.16600000000000001,"15min":0.16},"max":{"1min":0.436,"5min":0.47399999999999998,"15min":0.497},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28499999999999998},"min":{"1min":0.23000000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.25}]}]},{"osd":0,"up_from":8,"seq":34359740646,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181328,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94190512,"statfs":{"total":96636764160,"available":96451084288,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.156,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.371,"5min":0.38500000000000001,"15min":0.42699999999999999},"last":0.191},{"interface":"front","average":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23499999999999999},"min":{"1min":0.16400000000000001,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.43099999999999999,"5min":0.44800000000000001,"15min":0.45600000000000002},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Sep 28 16:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24299999999999999,"15min":0.247},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.438,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.245},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26100000000000001},"min":{"1min":0.19400000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.49299999999999999},"last":0.26700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740649,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245488,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60288,"kb_avail":94126352,"statfs":{"total":96636764160,"available":96385384448,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61734912},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.20899999999999999,"5min":0.20100000000000001,"15min":0.20999999999999999},"min":{"1min":0.156,"5min":0.14399999999999999,"15min":0.13900000000000001},"max":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.184},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26700000000000002},"min":{"1min":0.217,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.43099999999999999,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.246}]},{"osd":2,"last update":"Thu Sep 28 16:25:05 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.223,"15min":0.23000000000000001},"min":{"1min":0.19600000000000001,"5min":0.152,"15min":0.152},"max":{"1min":0.376,"5min":0.39600000000000002,"15min":0.443},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.26200000000000001},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.41599999999999998,"5min":0.434,"15min":0.48199999999999998},"last":0.26800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:26:08.122 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.122 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.123 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.123 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.123 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.123 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T13:16:38.721793+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=38, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.123 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.123 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.124 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.124 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.124 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:08.124 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-09-28T16:26:08.476 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-09-28T16:26:08.488 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-28T16:26:08.613 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:08.613+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:08.851 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-28T16:26:08.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-28T16:26:08.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:08.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:09.178 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-28T16:26:09.190 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-09-28T16:26:09.597 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-09-28T16:26:09.609 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-09-28T16:26:09.619 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:09.619+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:09.878 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:09.878+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:09.998 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-09-28T16:26:10.008 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-09-28T16:26:10.372 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-09-28T16:26:10.384 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-09-28T16:26:10.647 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:10.647+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:10.702 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-09-28T16:26:10.714 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-09-28T16:26:10.851 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:10.850+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:11.079 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-09-28T16:26:11.090 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-09-28T16:26:11.458 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-09-28T16:26:11.470 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-09-28T16:26:11.694 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:11.693+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:11.787 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-09-28T16:26:11.798 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-09-28T16:26:11.891 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:11.891+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:12.173 INFO:teuthology.orchestra.run.smithi069.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-09-28T16:26:12.185 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:26:12.671 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:12.671+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:12.845 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:12.844+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:13.695 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:13.694+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:13.815 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:13.815+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:14.726 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:14.726+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:14.859 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:14.859+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:15.745 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:15.745+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:15.909 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:15.909+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:16.711 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:16.711+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:16.913 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:16.913+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:17.665 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:17.665+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:17.927 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:17.926+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:18.704 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:18.703+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:18.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:18.934+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:19.693 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:19.693+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:19.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:19.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:20.687 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:20.687+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:20.921 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:20.921+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:21.699 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:21.699+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:21.941 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:21.941+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:22.685 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:22.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:22.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:22.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:23.728 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:23.728+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:23.931 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:23.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:24.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:24.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:24.890 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:24.889+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:25.708 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:25.708+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:25.877 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:25.877+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:26.673 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:26.672+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:26.903 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:26.903+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:27.669 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:27.669+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:27.945 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:27.944+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:28.678 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:28.678+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:28.985 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:28.984+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:29.633 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:29.632+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:29.962 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:29.962+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:30.674 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:30.674+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:30.961 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:30.961+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:31.683 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:31.682+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:32.007 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:32.007+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:32.186 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:26:32.501 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:26:32.503 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:26:32.514 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5855,"stamp":"2023-09-28T16:26:32.202415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1549,"num_omap_keys":165,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27173,"ondisk_log_size":27173,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":665796,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":161088,"kb_avail":282449724,"statfs":{"total":289910292480,"available":289228517376,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":164954112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":603,"num_omap_keys":66,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001903"},"pg_stats":[{"pgid":"2.7","version":"160'1046","reported_seq":2010,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:08.750055+0000","last_change":"2023-09-28T16:26:08.750019+0000","last_active":"2023-09-28T16:26:08.750055+0000","last_peered":"2023-09-28T16:26:08.750055+0000","last_clean":"2023-09-28T16:26:08.750055+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T16:26:08.750055+0000","last_undegraded":"2023-09-28T16:26:08.750055+0000","last_fullsized":"2023-09-28T16:26:08.750055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1046","last_scrub_stamp":"2023-09-28T16:26:08.749906+0000","last_deep_scrub":"160'1046","last_deep_scrub_stamp":"2023-09-28T16:26:08.749906+0000","last_clean_scrub_stamp":"2023-09-28T16:26:08.749906+0000","objects_scrubbed":31,"log_size":1046,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T19:39:48.838563+0000","scrub_duration":0.13658736099999999,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'937","reported_seq":1741,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T14:19:57.198995+0000","last_change":"2023-09-28T13:21:19.933464+0000","last_active":"2023-09-28T14:19:57.198995+0000","last_peered":"2023-09-28T14:19:57.198995+0000","last_clean":"2023-09-28T14:19:57.198995+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T14:19:57.198995+0000","last_undegraded":"2023-09-28T14:19:57.198995+0000","last_fullsized":"2023-09-28T14:19:57.198995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":937,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'1053","reported_seq":1977,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T14:19:57.199168+0000","last_change":"2023-09-28T13:21:19.933387+0000","last_active":"2023-09-28T14:19:57.199168+0000","last_peered":"2023-09-28T14:19:57.199168+0000","last_clean":"2023-09-28T14:19:57.199168+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T14:19:57.199168+0000","last_undegraded":"2023-09-28T14:19:57.199168+0000","last_fullsized":"2023-09-28T14:19:57.199168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:42.734009+0000","last_clean_scrub_stamp":"2023-09-28T13:16:42.734009+0000","objects_scrubbed":0,"log_size":1053,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"160'4130","reported_seq":9416,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:10.000691+0000","last_change":"2023-09-28T16:26:10.000667+0000","last_active":"2023-09-28T16:26:10.000691+0000","last_peered":"2023-09-28T16:26:10.000691+0000","last_clean":"2023-09-28T16:26:10.000691+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T16:26:10.000691+0000","last_undegraded":"2023-09-28T16:26:10.000691+0000","last_fullsized":"2023-09-28T16:26:10.000691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'4130","last_scrub_stamp":"2023-09-28T16:26:10.000571+0000","last_deep_scrub":"160'4130","last_deep_scrub_stamp":"2023-09-28T16:26:10.000571+0000","last_clean_scrub_stamp":"2023-09-28T16:26:10.000571+0000","objects_scrubbed":49,"log_size":4130,"ondisk_log_size":4130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T23:28:20.525008+0000","scrub_duration":0.122257409,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"158'4082","reported_seq":10640,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T14:19:57.199322+0000","last_change":"2023-09-28T13:21:19.934368+0000","last_active":"2023-09-28T14:19:57.199322+0000","last_peered":"2023-09-28T14:19:57.199322+0000","last_clean":"2023-09-28T14:19:57.199322+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T14:19:57.199322+0000","last_undegraded":"2023-09-28T14:19:57.199322+0000","last_fullsized":"2023-09-28T14:19:57.199322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4082,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"160'99","reported_seq":295,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:18.710076+0000","last_change":"2023-09-28T16:26:18.710055+0000","last_active":"2023-09-28T16:26:18.710076+0000","last_peered":"2023-09-28T16:26:18.710076+0000","last_clean":"2023-09-28T16:26:18.710076+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T16:26:18.710076+0000","last_undegraded":"2023-09-28T16:26:18.710076+0000","last_fullsized":"2023-09-28T16:26:18.710076+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'99","last_scrub_stamp":"2023-09-28T16:26:18.709980+0000","last_deep_scrub":"160'99","last_deep_scrub_stamp":"2023-09-28T16:26:18.709980+0000","last_clean_scrub_stamp":"2023-09-28T16:26:18.709980+0000","objects_scrubbed":2,"log_size":99,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:51:37.359198+0000","scrub_duration":0.0057541939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1470","reported_seq":2468,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:29.758427+0000","last_change":"2023-09-28T16:26:29.758403+0000","last_active":"2023-09-28T16:26:29.758427+0000","last_peered":"2023-09-28T16:26:29.758427+0000","last_clean":"2023-09-28T16:26:29.758427+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T16:26:29.758427+0000","last_undegraded":"2023-09-28T16:26:29.758427+0000","last_fullsized":"2023-09-28T16:26:29.758427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1470","last_scrub_stamp":"2023-09-28T16:26:29.758326+0000","last_deep_scrub":"160'1470","last_deep_scrub_stamp":"2023-09-28T16:26:29.758326+0000","last_clean_scrub_stamp":"2023-09-28T16:26:29.758326+0000","objects_scrubbed":51,"log_size":1470,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:08:23.242877+0000","scrub_duration":0.12516596099999999,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":429,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"158'4783","reported_seq":11121,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T14:19:57.199213+0000","last_change":"2023-09-28T13:21:19.934412+0000","last_active":"2023-09-28T14:19:57.199213+0000","last_peered":"2023-09-28T14:19:57.199213+0000","last_clean":"2023-09-28T14:19:57.199213+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T14:19:57.199213+0000","last_undegraded":"2023-09-28T14:19:57.199213+0000","last_fullsized":"2023-09-28T14:19:57.199213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T13:16:49.750894+0000","last_clean_scrub_stamp":"2023-09-28T13:16:49.750894+0000","objects_scrubbed":0,"log_size":4783,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"160'4576","reported_seq":12316,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:18.094611+0000","last_change":"2023-09-28T16:26:18.094559+0000","last_active":"2023-09-28T16:26:18.094611+0000","last_peered":"2023-09-28T16:26:18.094611+0000","last_clean":"2023-09-28T16:26:18.094611+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T16:26:18.094611+0000","last_undegraded":"2023-09-28T16:26:18.094611+0000","last_fullsized":"2023-09-28T16:26:18.094611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'4576","last_scrub_stamp":"2023-09-28T16:26:18.094456+0000","last_deep_scrub":"160'4576","last_deep_scrub_stamp":"2023-09-28T16:26:18.094456+0000","last_clean_scrub_stamp":"2023-09-28T16:26:18.094456+0000","objects_scrubbed":51,"log_size":4576,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T23:37:43.306067+0000","scrub_duration":0.16721060600000001,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1162","reported_seq":2225,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:12.021952+0000","last_change":"2023-09-28T16:26:12.021928+0000","last_active":"2023-09-28T16:26:12.021952+0000","last_peered":"2023-09-28T16:26:12.021952+0000","last_clean":"2023-09-28T16:26:12.021952+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T16:26:12.021952+0000","last_undegraded":"2023-09-28T16:26:12.021952+0000","last_fullsized":"2023-09-28T16:26:12.021952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1162","last_scrub_stamp":"2023-09-28T16:26:12.021843+0000","last_deep_scrub":"160'1162","last_deep_scrub_stamp":"2023-09-28T16:26:12.021843+0000","last_clean_scrub_stamp":"2023-09-28T16:26:12.021843+0000","objects_scrubbed":46,"log_size":1162,"ondisk_log_size":1162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T18:57:26.478662+0000","scrub_duration":0.12996658799999999,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":354,"num_omap_keys":34,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"160'997","reported_seq":1981,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:30.739406+0000","last_change":"2023-09-28T16:26:30.739384+0000","last_active":"2023-09-28T16:26:30.739406+0000","last_peered":"2023-09-28T16:26:30.739406+0000","last_clean":"2023-09-28T16:26:30.739406+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T16:26:30.739406+0000","last_undegraded":"2023-09-28T16:26:30.739406+0000","last_fullsized":"2023-09-28T16:26:30.739406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'997","last_scrub_stamp":"2023-09-28T16:26:30.739306+0000","last_deep_scrub":"160'997","last_deep_scrub_stamp":"2023-09-28T16:26:30.739306+0000","last_clean_scrub_stamp":"2023-09-28T16:26:30.739306+0000","objects_scrubbed":27,"log_size":997,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:05:32.142975+0000","scrub_duration":0.064331527999999999,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17571,"ondisk_log_size":17571,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1523,"num_omap_keys":162,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9503,"ondisk_log_size":9503,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740655,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238596,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55232,"kb_avail":94133244,"statfs":{"total":96636764160,"available":96392441856,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56557568},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.154,"5min":0.14299999999999999,"15min":0.14199999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.26800000000000002},"min":{"1min":0.23400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.55100000000000005},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Sep 28 16:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.246,"15min":0.24099999999999999},"min":{"1min":0.17299999999999999,"5min":0.16600000000000001,"15min":0.16},"max":{"1min":0.436,"5min":0.47399999999999998,"15min":0.497},"last":0.214},{"interface":"front","average":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28499999999999998},"min":{"1min":0.23000000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.27600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740652,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181520,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45376,"kb_avail":94190320,"statfs":{"total":96636764160,"available":96450887680,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46465024},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20599999999999999,"15min":0.214},"min":{"1min":0.161,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.255},{"interface":"front","average":{"1min":0.245,"5min":0.24099999999999999,"15min":0.23499999999999999},"min":{"1min":0.189,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.24199999999999999,"15min":0.246},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.41599999999999998,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.26100000000000001},"min":{"1min":0.21299999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.42499999999999999,"5min":0.45200000000000001,"15min":0.49299999999999999},"last":0.30099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740655,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245680,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60480,"kb_avail":94126160,"statfs":{"total":96636764160,"available":96385187840,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":61931520},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.20300000000000001,"15min":0.20899999999999999},"min":{"1min":0.14000000000000001,"5min":0.14000000000000001,"15min":0.13900000000000001},"max":{"1min":0.32200000000000001,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.186},{"interface":"front","average":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26500000000000001},"min":{"1min":0.19,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.38400000000000001,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22800000000000001},"min":{"1min":0.161,"5min":0.152,"15min":0.152},"max":{"1min":0.36599999999999999,"5min":0.39600000000000002,"15min":0.443},"last":0.221},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"min":{"1min":0.20200000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.40000000000000002,"5min":0.434,"15min":0.48199999999999998},"last":0.251}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:26:32.516 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:32.516 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T13:16:42.734009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=42, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:32.516 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:32.517 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T13:16:49.750894+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=13, tm_min=16, tm_sec=49, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=16, tm_min=19, tm_sec=43, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T16:26:32.517 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T16:26:32.707 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:32.706+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:32.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:32.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:33.719 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:33.718+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:34.019 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:34.019+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:34.684 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:34.684+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:35.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:35.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:35.657 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:35.656+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:36.032 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:36.032+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:36.616 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:36.616+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:36.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:36.996+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:37.569 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:37.568+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:38.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:38.042+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:38.540 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:38.539+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:39.004 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:39.003+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:39.580 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:39.579+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:40.035 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:40.035+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:40.600 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:40.600+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:40.997 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:40.996+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:41.627 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:41.627+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:42.046 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:42.045+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:42.630 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:42.629+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:43.002 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:43.001+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:43.637 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:43.637+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:43.974 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:43.973+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:44.609 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:44.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:44.996 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:44.995+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:45.668 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:45.645+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:46.008 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:46.008+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:46.677 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:46.678+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:46.968 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:46.968+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:47.650 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:47.651+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:47.993 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:47.993+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:48.659 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:48.659+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:48.970 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:48.969+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:49.638 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:49.638+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:49.973 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:49.974+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:50.632 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:50.633+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:50.935 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:50.936+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:51.608 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:51.608+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:51.898 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:51.898+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:52.518 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T16:26:52.617 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-09-28T16:26:52.618+0000 7fab1f6c6700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1395 3.2 3:7482f3bf:test1::rbd_data.295a6e1dda4.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2510848~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:52.844 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T16:26:52.846 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-09-28T16:26:52.857 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5865,"stamp":"2023-09-28T16:26:52.205662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1056498663,"num_objects":519,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":146,"num_read":65767,"num_read_kb":138596,"num_write":19403,"num_write_kb":8851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1919,"num_omap_keys":206,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27340,"ondisk_log_size":27340,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":666244,"kb_used_data":504684,"kb_used_omap":0,"kb_used_meta":161536,"kb_avail":282449276,"statfs":{"total":289910292480,"available":289228058624,"internally_reserved":0,"allocated":516796416,"data_stored":514472209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165412864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":41,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002002"},"pg_stats":[{"pgid":"2.7","version":"160'1046","reported_seq":2010,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:08.750055+0000","last_change":"2023-09-28T16:26:08.750019+0000","last_active":"2023-09-28T16:26:08.750055+0000","last_peered":"2023-09-28T16:26:08.750055+0000","last_clean":"2023-09-28T16:26:08.750055+0000","last_became_active":"2023-09-28T13:16:43.751992+0000","last_became_peered":"2023-09-28T13:16:43.751992+0000","last_unstale":"2023-09-28T16:26:08.750055+0000","last_undegraded":"2023-09-28T16:26:08.750055+0000","last_fullsized":"2023-09-28T16:26:08.750055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1046","last_scrub_stamp":"2023-09-28T16:26:08.749906+0000","last_deep_scrub":"160'1046","last_deep_scrub_stamp":"2023-09-28T16:26:08.749906+0000","last_clean_scrub_stamp":"2023-09-28T16:26:08.749906+0000","objects_scrubbed":31,"log_size":1046,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T19:39:48.838563+0000","scrub_duration":0.13658736099999999,"objects_trimmed":0,"snaptrim_duration":0.00056845400000000003,"stat_sum":{"num_bytes":113483776,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":747,"num_read_kb":2329,"num_write":875,"num_write_kb":1082873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'964","reported_seq":1779,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:41.710096+0000","last_change":"2023-09-28T16:26:41.710072+0000","last_active":"2023-09-28T16:26:41.710096+0000","last_peered":"2023-09-28T16:26:41.710096+0000","last_clean":"2023-09-28T16:26:41.710096+0000","last_became_active":"2023-09-28T13:16:43.752077+0000","last_became_peered":"2023-09-28T13:16:43.752077+0000","last_unstale":"2023-09-28T16:26:41.710096+0000","last_undegraded":"2023-09-28T16:26:41.710096+0000","last_fullsized":"2023-09-28T16:26:41.710096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'964","last_scrub_stamp":"2023-09-28T16:26:41.709979+0000","last_deep_scrub":"160'964","last_deep_scrub_stamp":"2023-09-28T16:26:41.709979+0000","last_clean_scrub_stamp":"2023-09-28T16:26:41.709979+0000","objects_scrubbed":27,"log_size":964,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:14:21.845125+0000","scrub_duration":0.082305729999999994,"objects_trimmed":0,"snaptrim_duration":0.00055601700000000001,"stat_sum":{"num_bytes":71196807,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":511,"num_read_kb":5201,"num_write":752,"num_write_kb":994355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1089","reported_seq":2024,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:39.671321+0000","last_change":"2023-09-28T16:26:39.671298+0000","last_active":"2023-09-28T16:26:39.671321+0000","last_peered":"2023-09-28T16:26:39.671321+0000","last_clean":"2023-09-28T16:26:39.671321+0000","last_became_active":"2023-09-28T13:16:43.752709+0000","last_became_peered":"2023-09-28T13:16:43.752709+0000","last_unstale":"2023-09-28T16:26:39.671321+0000","last_undegraded":"2023-09-28T16:26:39.671321+0000","last_fullsized":"2023-09-28T16:26:39.671321+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1089","last_scrub_stamp":"2023-09-28T16:26:39.671219+0000","last_deep_scrub":"160'1089","last_deep_scrub_stamp":"2023-09-28T16:26:39.671219+0000","last_clean_scrub_stamp":"2023-09-28T16:26:39.671219+0000","objects_scrubbed":36,"log_size":1089,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T19:25:33.189891+0000","scrub_duration":0.090759936999999999,"objects_trimmed":0,"snaptrim_duration":0.00048650100000000002,"stat_sum":{"num_bytes":113910050,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":745,"num_read_kb":1454,"num_write":899,"num_write_kb":1130416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"160'4130","reported_seq":9416,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:10.000691+0000","last_change":"2023-09-28T16:26:10.000667+0000","last_active":"2023-09-28T16:26:10.000691+0000","last_peered":"2023-09-28T16:26:10.000691+0000","last_clean":"2023-09-28T16:26:10.000691+0000","last_became_active":"2023-09-28T13:16:50.814676+0000","last_became_peered":"2023-09-28T13:16:50.814676+0000","last_unstale":"2023-09-28T16:26:10.000691+0000","last_undegraded":"2023-09-28T16:26:10.000691+0000","last_fullsized":"2023-09-28T16:26:10.000691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'4130","last_scrub_stamp":"2023-09-28T16:26:10.000571+0000","last_deep_scrub":"160'4130","last_deep_scrub_stamp":"2023-09-28T16:26:10.000571+0000","last_clean_scrub_stamp":"2023-09-28T16:26:10.000571+0000","objects_scrubbed":49,"log_size":4130,"ondisk_log_size":4130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T23:28:20.525008+0000","scrub_duration":0.122257409,"objects_trimmed":0,"snaptrim_duration":0.000211898,"stat_sum":{"num_bytes":26763556,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":17678,"num_read_kb":35281,"num_write":3702,"num_write_kb":2936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":292,"num_flush":180,"num_flush_kb":21,"num_evict":512,"num_evict_kb":61990,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1731","reported_seq":2678,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:45.830771+0000","last_change":"2023-09-28T16:23:45.830731+0000","last_active":"2023-09-28T16:23:45.830771+0000","last_peered":"2023-09-28T16:23:45.830771+0000","last_clean":"2023-09-28T16:23:45.830771+0000","last_became_active":"2023-09-28T13:16:43.749389+0000","last_became_peered":"2023-09-28T13:16:43.749389+0000","last_unstale":"2023-09-28T16:23:45.830771+0000","last_undegraded":"2023-09-28T16:23:45.830771+0000","last_fullsized":"2023-09-28T16:23:45.830771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1731","last_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_deep_scrub":"160'1731","last_deep_scrub_stamp":"2023-09-28T16:23:45.830642+0000","last_clean_scrub_stamp":"2023-09-28T16:23:45.830642+0000","objects_scrubbed":51,"log_size":1731,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T20:17:45.247457+0000","scrub_duration":0.17634838899999999,"objects_trimmed":0,"snaptrim_duration":0.000269852,"stat_sum":{"num_bytes":163016874,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":653,"num_read_kb":1160,"num_write":1089,"num_write_kb":1157133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":222,"num_omap_keys":25,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"160'4134","reported_seq":10704,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:46.800799+0000","last_change":"2023-09-28T16:26:46.800775+0000","last_active":"2023-09-28T16:26:46.800799+0000","last_peered":"2023-09-28T16:26:46.800799+0000","last_clean":"2023-09-28T16:26:46.800799+0000","last_became_active":"2023-09-28T13:16:50.814053+0000","last_became_peered":"2023-09-28T13:16:50.814053+0000","last_unstale":"2023-09-28T16:26:46.800799+0000","last_undegraded":"2023-09-28T16:26:46.800799+0000","last_fullsized":"2023-09-28T16:26:46.800799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'4134","last_scrub_stamp":"2023-09-28T16:26:46.800688+0000","last_deep_scrub":"160'4134","last_deep_scrub_stamp":"2023-09-28T16:26:46.800688+0000","last_clean_scrub_stamp":"2023-09-28T16:26:46.800688+0000","objects_scrubbed":52,"log_size":4134,"ondisk_log_size":4134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:24:36.862991+0000","scrub_duration":0.122464171,"objects_trimmed":0,"snaptrim_duration":0.00049505299999999996,"stat_sum":{"num_bytes":35894215,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":35,"num_read":13512,"num_read_kb":39868,"num_write":2419,"num_write_kb":1381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":854,"num_flush":183,"num_flush_kb":19,"num_evict":558,"num_evict_kb":20093,"num_promote":605,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"160'99","reported_seq":295,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:18.710076+0000","last_change":"2023-09-28T16:26:18.710055+0000","last_active":"2023-09-28T16:26:18.710076+0000","last_peered":"2023-09-28T16:26:18.710076+0000","last_clean":"2023-09-28T16:26:18.710076+0000","last_became_active":"2023-09-28T13:16:39.731025+0000","last_became_peered":"2023-09-28T13:16:39.731025+0000","last_unstale":"2023-09-28T16:26:18.710076+0000","last_undegraded":"2023-09-28T16:26:18.710076+0000","last_fullsized":"2023-09-28T16:26:18.710076+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'99","last_scrub_stamp":"2023-09-28T16:26:18.709980+0000","last_deep_scrub":"160'99","last_deep_scrub_stamp":"2023-09-28T16:26:18.709980+0000","last_clean_scrub_stamp":"2023-09-28T16:26:18.709980+0000","objects_scrubbed":2,"log_size":99,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:51:37.359198+0000","scrub_duration":0.0057541939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1470","reported_seq":2468,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:29.758427+0000","last_change":"2023-09-28T16:26:29.758403+0000","last_active":"2023-09-28T16:26:29.758427+0000","last_peered":"2023-09-28T16:26:29.758427+0000","last_clean":"2023-09-28T16:26:29.758427+0000","last_became_active":"2023-09-28T13:16:43.749530+0000","last_became_peered":"2023-09-28T13:16:43.749530+0000","last_unstale":"2023-09-28T16:26:29.758427+0000","last_undegraded":"2023-09-28T16:26:29.758427+0000","last_fullsized":"2023-09-28T16:26:29.758427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1470","last_scrub_stamp":"2023-09-28T16:26:29.758326+0000","last_deep_scrub":"160'1470","last_deep_scrub_stamp":"2023-09-28T16:26:29.758326+0000","last_clean_scrub_stamp":"2023-09-28T16:26:29.758326+0000","objects_scrubbed":51,"log_size":1470,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:08:23.242877+0000","scrub_duration":0.12516596099999999,"objects_trimmed":0,"snaptrim_duration":0.00029176400000000002,"stat_sum":{"num_bytes":123232556,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":807,"num_read_kb":1858,"num_write":843,"num_write_kb":1052275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":429,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"160'4835","reported_seq":11185,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:43.761016+0000","last_change":"2023-09-28T16:26:43.760993+0000","last_active":"2023-09-28T16:26:43.761016+0000","last_peered":"2023-09-28T16:26:43.761016+0000","last_clean":"2023-09-28T16:26:43.761016+0000","last_became_active":"2023-09-28T13:16:50.813992+0000","last_became_peered":"2023-09-28T13:16:50.813992+0000","last_unstale":"2023-09-28T16:26:43.761016+0000","last_undegraded":"2023-09-28T16:26:43.761016+0000","last_fullsized":"2023-09-28T16:26:43.761016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'4835","last_scrub_stamp":"2023-09-28T16:26:43.760907+0000","last_deep_scrub":"160'4835","last_deep_scrub_stamp":"2023-09-28T16:26:43.760907+0000","last_clean_scrub_stamp":"2023-09-28T16:26:43.760907+0000","objects_scrubbed":52,"log_size":4835,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T22:29:00.995659+0000","scrub_duration":0.12319568,"objects_trimmed":0,"snaptrim_duration":0.00051183100000000003,"stat_sum":{"num_bytes":26031210,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":39,"num_read":13464,"num_read_kb":20857,"num_write":2769,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1122,"num_flush":191,"num_flush_kb":16510,"num_evict":479,"num_evict_kb":25372,"num_promote":526,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1107","reported_seq":2028,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:23:46.824040+0000","last_change":"2023-09-28T16:23:46.824005+0000","last_active":"2023-09-28T16:23:46.824040+0000","last_peered":"2023-09-28T16:23:46.824040+0000","last_clean":"2023-09-28T16:23:46.824040+0000","last_became_active":"2023-09-28T13:16:43.749415+0000","last_became_peered":"2023-09-28T13:16:43.749415+0000","last_unstale":"2023-09-28T16:23:46.824040+0000","last_undegraded":"2023-09-28T16:23:46.824040+0000","last_fullsized":"2023-09-28T16:23:46.824040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1107","last_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_deep_scrub":"160'1107","last_deep_scrub_stamp":"2023-09-28T16:23:46.823887+0000","last_clean_scrub_stamp":"2023-09-28T16:23:46.823887+0000","objects_scrubbed":44,"log_size":1107,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T03:39:16.026544+0000","scrub_duration":0.13180816100000001,"objects_trimmed":0,"snaptrim_duration":0.00033229000000000001,"stat_sum":{"num_bytes":130146539,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":649,"num_read_kb":1523,"num_write":937,"num_write_kb":1136813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":370,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"160'4576","reported_seq":12316,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:18.094611+0000","last_change":"2023-09-28T16:26:18.094559+0000","last_active":"2023-09-28T16:26:18.094611+0000","last_peered":"2023-09-28T16:26:18.094611+0000","last_clean":"2023-09-28T16:26:18.094611+0000","last_became_active":"2023-09-28T13:16:50.813976+0000","last_became_peered":"2023-09-28T13:16:50.813976+0000","last_unstale":"2023-09-28T16:26:18.094611+0000","last_undegraded":"2023-09-28T16:26:18.094611+0000","last_fullsized":"2023-09-28T16:26:18.094611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'4576","last_scrub_stamp":"2023-09-28T16:26:18.094456+0000","last_deep_scrub":"160'4576","last_deep_scrub_stamp":"2023-09-28T16:26:18.094456+0000","last_clean_scrub_stamp":"2023-09-28T16:26:18.094456+0000","objects_scrubbed":51,"log_size":4576,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T23:37:43.306067+0000","scrub_duration":0.16721060600000001,"objects_trimmed":0,"snaptrim_duration":0.0025164530000000001,"stat_sum":{"num_bytes":58298993,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":15248,"num_read_kb":23513,"num_write":3164,"num_write_kb":2036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":625,"num_flush":210,"num_flush_kb":23124,"num_evict":465,"num_evict_kb":32538,"num_promote":513,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1162","reported_seq":2225,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:12.021952+0000","last_change":"2023-09-28T16:26:12.021928+0000","last_active":"2023-09-28T16:26:12.021952+0000","last_peered":"2023-09-28T16:26:12.021952+0000","last_clean":"2023-09-28T16:26:12.021952+0000","last_became_active":"2023-09-28T13:16:43.752321+0000","last_became_peered":"2023-09-28T13:16:43.752321+0000","last_unstale":"2023-09-28T16:26:12.021952+0000","last_undegraded":"2023-09-28T16:26:12.021952+0000","last_fullsized":"2023-09-28T16:26:12.021952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1162","last_scrub_stamp":"2023-09-28T16:26:12.021843+0000","last_deep_scrub":"160'1162","last_deep_scrub_stamp":"2023-09-28T16:26:12.021843+0000","last_clean_scrub_stamp":"2023-09-28T16:26:12.021843+0000","objects_scrubbed":46,"log_size":1162,"ondisk_log_size":1162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T18:57:26.478662+0000","scrub_duration":0.12996658799999999,"objects_trimmed":0,"snaptrim_duration":0.00030318100000000002,"stat_sum":{"num_bytes":127873291,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":867,"num_read_kb":3873,"num_write":966,"num_write_kb":1121508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":354,"num_omap_keys":34,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"160'997","reported_seq":1981,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-09-28T16:26:30.739406+0000","last_change":"2023-09-28T16:26:30.739384+0000","last_active":"2023-09-28T16:26:30.739406+0000","last_peered":"2023-09-28T16:26:30.739406+0000","last_clean":"2023-09-28T16:26:30.739406+0000","last_became_active":"2023-09-28T13:16:43.752456+0000","last_became_peered":"2023-09-28T13:16:43.752456+0000","last_unstale":"2023-09-28T16:26:30.739406+0000","last_undegraded":"2023-09-28T16:26:30.739406+0000","last_fullsized":"2023-09-28T16:26:30.739406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'997","last_scrub_stamp":"2023-09-28T16:26:30.739306+0000","last_deep_scrub":"160'997","last_deep_scrub_stamp":"2023-09-28T16:26:30.739306+0000","last_clean_scrub_stamp":"2023-09-28T16:26:30.739306+0000","objects_scrubbed":27,"log_size":997,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T21:05:32.142975+0000","scrub_duration":0.064331527999999999,"objects_trimmed":0,"snaptrim_duration":0.00066226200000000005,"stat_sum":{"num_bytes":66060428,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":780,"num_read_kb":1588,"num_write":851,"num_write_kb":1166146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":146987974,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":146,"num_read":59902,"num_read_kb":119519,"num_write":12054,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":13,"num_bytes_hit_set_archive":2893,"num_flush":764,"num_flush_kb":39674,"num_evict":2014,"num_evict_kb":139993,"num_promote":2204,"num_flush_mode_high":0,"num_flush_mode_low":4,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":216170496,"data_stored":216045452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17675,"ondisk_log_size":17675,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":908920321,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":5759,"num_read_kb":18986,"num_write":7212,"num_write_kb":8841519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1820,"num_omap_keys":195,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295419904,"data_stored":295177218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9566,"ondisk_log_size":9566,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740659,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238724,"kb_used_data":183356,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":94133116,"statfs":{"total":96636764160,"available":96392310784,"internally_reserved":0,"allocated":187756544,"data_stored":186983496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.158,"5min":0.14299999999999999,"15min":0.14199999999999999},"max":{"1min":0.29699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.27300000000000002,"15min":0.26800000000000002},"min":{"1min":0.20499999999999999,"5min":0.17499999999999999,"15min":0.156},"max":{"1min":0.32000000000000001,"5min":0.50800000000000001,"15min":0.55100000000000005},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Sep 28 16:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.251,"15min":0.24199999999999999},"min":{"1min":0.186,"5min":0.16800000000000001,"15min":0.16},"max":{"1min":0.307,"5min":0.47399999999999998,"15min":0.497},"last":0.218},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.28699999999999998,"15min":0.28599999999999998},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.34000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.308}]}]},{"osd":0,"up_from":8,"seq":34359740656,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181648,"kb_used_data":136136,"kb_used_omap":0,"kb_used_meta":45504,"kb_avail":94190192,"statfs":{"total":96636764160,"available":96450756608,"internally_reserved":0,"allocated":139403264,"data_stored":138673846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46596096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 16:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20599999999999999,"15min":0.214},"min":{"1min":0.161,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.245,"5min":0.24099999999999999,"15min":0.23499999999999999},"min":{"1min":0.189,"5min":0.16200000000000001,"15min":0.159},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.20999999999999999}]},{"osd":2,"last update":"Thu Sep 28 16:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.24199999999999999,"15min":0.246},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.41599999999999998,"5min":0.47099999999999997,"15min":0.47799999999999998},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.26100000000000001},"min":{"1min":0.21299999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.42499999999999999,"5min":0.45200000000000001,"15min":0.49299999999999999},"last":0.249}]}]},{"osd":1,"up_from":8,"seq":34359740659,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245872,"kb_used_data":185192,"kb_used_omap":0,"kb_used_meta":60672,"kb_avail":94125968,"statfs":{"total":96636764160,"available":96384991232,"internally_reserved":0,"allocated":189636608,"data_stored":188814867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62128128},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 16:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.20300000000000001,"15min":0.20899999999999999},"min":{"1min":0.14000000000000001,"5min":0.14000000000000001,"15min":0.13900000000000001},"max":{"1min":0.32200000000000001,"5min":0.36799999999999999,"15min":0.45600000000000002},"last":0.14699999999999999},{"interface":"front","average":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26500000000000001},"min":{"1min":0.19,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.38400000000000001,"5min":0.45000000000000001,"15min":0.50600000000000001},"last":0.20100000000000001}]},{"osd":2,"last update":"Thu Sep 28 16:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22800000000000001},"min":{"1min":0.161,"5min":0.152,"15min":0.152},"max":{"1min":0.36599999999999999,"5min":0.39600000000000002,"15min":0.443},"last":0.17100000000000001},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"min":{"1min":0.20200000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.40000000000000002,"5min":0.434,"15min":0.48199999999999998},"last":0.214}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69378048,"data_stored":69317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147709952,"data_stored":147588609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78331904,"data_stored":78271169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68091904,"data_stored":68076437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39993344,"data_stored":39946289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108085248,"data_stored":108022726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T16:26:52.861 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-28T16:26:52.930 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-09-28T16:26:52.931+0000 7f96f0ee4700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10589.0:1994 3.3 3:dc0c912b:test1::rbd_data.295a6e1dda4.000000000000003b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1830912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e158) 2023-09-28T16:26:53.195 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-28T16:26:53.195 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-28T16:26:53.196 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-28T16:26:53.196 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T16:26:53.244 INFO:tasks.ceph.osd.0:Stopped 2023-09-28T16:26:53.245 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-28T16:26:53.245 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T16:26:53.301 INFO:tasks.ceph.osd.1:Stopped 2023-09-28T16:26:53.301 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-28T16:26:53.301 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T16:26:53.350 INFO:tasks.ceph.osd.2:Stopped 2023-09-28T16:26:53.350 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-28T16:26:53.350 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-28T16:26:53.350 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T16:26:53.375 INFO:tasks.ceph.mgr.x:Stopped 2023-09-28T16:26:53.375 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-28T16:26:53.376 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-28T16:26:53.376 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T16:26:53.432 INFO:tasks.ceph.mon.a:Stopped 2023-09-28T16:26:53.433 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-28T16:26:53.433 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2023-09-28T16:26:53.497 INFO:teuthology.orchestra.run.smithi069.stdout:1695907330.9422908 osd.1 (osd.1) 3 : cluster [WRN] 256 slow requests (by type [ 'reached pg' : 256 ] most affected pool [ 'cache' : 256 ]) 2023-09-28T16:26:53.499 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-09-28T16:26:53.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T16:26:53.499 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-28T16:26:53.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T16:26:53.895 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-28T16:26:54.036 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T16:26:54.036 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-28T16:26:54.106 INFO:tasks.ceph:Archiving mon data... 2023-09-28T16:26:54.108 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802/data/mon.a.tgz 2023-09-28T16:26:54.108 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-09-28T16:26:54.123 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.D6Y68lb3lI 2023-09-28T16:26:54.123 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.D6Y68lb3lI 2023-09-28T16:26:54.267 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.D6Y68lb3lI 2023-09-28T16:26:54.348 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.D6Y68lb3lI is 403KB 2023-09-28T16:26:54.449 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.D6Y68lb3lI 2023-09-28T16:26:54.463 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-28T16:26:54.464 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-28T16:26:54.526 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-28T16:26:54.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-28T16:26:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-28T16:26:54.598 INFO:tasks.ceph:Archiving crash dumps... 2023-09-28T16:26:54.600 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802/remote/smithi069/crash 2023-09-28T16:26:54.601 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-28T16:26:54.662 INFO:tasks.ceph:Compressing logs... 2023-09-28T16:26:54.663 DEBUG:teuthology.orchestra.run.smithi069:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T16:28:54.380 INFO:tasks.ceph:Archiving logs... 2023-09-28T16:28:54.380 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802/remote/smithi069/log 2023-09-28T16:28:54.381 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-28T16:29:04.531 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-28T16:29:04.542 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-28T16:29:04.543 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-28T16:29:04.597 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-28T16:29:04.608 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-28T16:29:04.608 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T16:29:04.628 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-09-28T16:29:04.632 INFO:teuthology.orchestra.run.smithi069.stdout:210 Number of sources = 4 2023-09-28T16:29:04.632 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T16:29:04.632 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-09-28T16:29:04.632 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 72 -586us[ -586us] +/- 83ms 2023-09-28T16:29:04.633 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 8 377 184 -333us[ -309us] +/- 60ms 2023-09-28T16:29:04.633 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 108 +911us[ +911us] +/- 67ms 2023-09-28T16:29:04.633 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T16:29:04.634 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-28T16:29:04.642 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-28T16:29:04.643 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-28T16:29:04.650 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-28T16:29:04.798 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T16:29:04.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T16:29:04.829 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-28T16:29:04.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-28T16:29:04.846 INFO:teuthology.task.internal:Duration was 12307.551914 seconds 2023-09-28T16:29:04.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-28T16:29:04.855 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-28T16:29:04.855 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-28T16:29:04.914 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T16:29:05.050 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-28T16:29:05.050 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2023-09-28T16:29:05.051 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-28T16:29:05.068 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-28T16:29:05.069 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T16:29:05.148 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-28T16:29:05.148 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-28T16:29:05.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-28T16:29:05.272 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-28T16:29:05.272 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-28T16:29:05.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-28T16:29:05.316 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-28T16:29:05.360 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2023-09-28T16:29:05.374 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-28T16:29:05.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T16:29:05.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-28T16:29:05.438 INFO:teuthology.task.internal:Transferring archived files... 2023-09-28T16:29:05.439 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802/remote/smithi069 2023-09-28T16:29:05.440 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-28T16:29:05.503 INFO:teuthology.task.internal:Removing archive directory... 2023-09-28T16:29:05.503 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-28T16:29:05.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-28T16:29:05.562 INFO:teuthology.task.internal:Not uploading archives. 2023-09-28T16:29:05.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-28T16:29:05.572 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-28T16:29:05.572 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-28T16:29:05.605 INFO:teuthology.orchestra.run.smithi069.stdout: 262672 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 28 16:29 /home/ubuntu/cephtest 2023-09-28T16:29:05.605 INFO:teuthology.orchestra.run.smithi069.stdout: 658804 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 28 13:16 /home/ubuntu/cephtest/mnt.0 2023-09-28T16:29:05.605 INFO:teuthology.orchestra.run.smithi069.stdout: 658805 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 28 13:17 /home/ubuntu/cephtest/mnt.0/client.0 2023-09-28T16:29:05.606 INFO:teuthology.orchestra.run.smithi069.stdout: 658845 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 28 13:17 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-28T16:29:05.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T16:29:05.607 INFO:teuthology.orchestra.run.smithi069.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-28T16:29:05.607 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T16:29:05.615 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-28T16:29:05.625 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-28T16:29:05.636 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi069 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T16:29:05.636 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T16:29:05.674 DEBUG:teuthology.nuke:shortname: smithi069 2023-09-28T16:29:05.675 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T16:29:05.696 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:28:09-rbd-wip-yuri3-testing-2023-09-27-0919-quincy-distro-default-smithi/7403802', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 12:56:51.357886', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnJDlS/BXlSINjJJGcXbSPxbGrNZzdOVEDfBuvbD1N26QyGYGlNYw62XUaigjgXCvDWBhNHQtSmoc/xGP0IEDE='} 2023-09-28T16:29:05.749 INFO:teuthology.orchestra.console.smithi069:Power off 2023-09-28T16:29:05.749 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T16:29:05.772 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-09-28T16:29:05.773 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T16:29:05.795 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-28T16:29:09.797 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T16:29:09.906 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-28T16:29:13.910 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T16:29:14.019 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-28T16:29:14.120 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-09-28T16:29:14.225 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} duration: 12307.551914453506 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi069 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2c186684db7f9ea0cdb098fc86b350a0fdd26eba TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a3decacfff8140dc981cd91ce67dfd14 status: fail success: false 2023-09-28T16:29:14.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T16:29:14.366 INFO:teuthology.run:FAIL